WP30: analysis, router, mapper, hosted track, protocol/audit/reproduce modules, paper skeleton, core configs
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
45 changed files +9,127 −751
modified
DECISIONS.md
+1 −0
@@ -16,3 +16,4 @@ All times America/Toronto unless noted. | ||
| 16 | 16 | - **D-010 Exec family difficulty (dev-only decision, 2026-10-30).** With the 7-rule specification the receiver (Qwen2.5-3B) failed even with the full ticket (A1 pass rate 0 on the smoke item: it duplicated the loop instead of composing the discount rule), so the family could not discriminate between communication methods. The specification was reduced to 6 rules with two missing in the buggy code (region exclusion, tax). Hidden tests unchanged in form (5 subsets, exact float match). Datasets regenerated before any test-split evaluation. |
| 17 | 17 | - **D-011 Network path for E2/E6 (2026-10-30).** The laptop cannot open TCP connections to the nodes' LAN addresses (192.168.2.x; its SSH goes through Tailscale, whose ACL blocks non-SSH ports). Genuine two-node measurements therefore run **between two cluster nodes on the wired LAN**: sender/client on M3U96a (192.168.2.80), receiver worker on M3U96b (192.168.2.85). Measured link: iperf3 4 streams ≈ 940 Mbit/s (1 GbE, not 10 GbE as older notes suggested), RTT ≈ 1.2 ms. Both nodes concurrently host a CPU-light workload from another study (WP29 `claude --bare` executors); load average ≈ 1.8 on 32 cores at setup time; recorded as a limitation. |
| 18 | 18 | - **D-012 Learned mapper scope (Track C).** Level 2 (same family, different size): Qwen2.5-1.5B → Qwen2.5-3B share the tokenizer (token-aligned), both have 2 KV heads × 128 dims but 28 vs 36 layers → per-receiver-layer linear maps from an aligned sender layer, trained on train-split caches only (reconstruction loss; optional distillation). Level 3 (cross-family Llama-3.2-3B → Qwen2.5-3B) requires tokenizer alignment by character spans; attempted only if level 2 completes; labelled "adapted (SwaT-inspired), not a SwaT reproduction" (SwaT has no public checkpoint or licence). |
| 19 | +- **D-013 Pilot scope reduced (2026-10-30).** After 120 trials the pilot ran at ≈5 trials/min (sender generations for question-aware A4/A5 dominate, GPU shared with mapper training), projecting > 12 h for 4 092 trials. Pilot reduced to 4 documents per family and 5 questions per document (1 984 trials) via `--resume` (trial keys unchanged). Pilot timings are not used for any claim; the core campaign runs alone on the GPU. | |
added
Makefile
+10 −0
@@ -0,0 +1,10 @@ | ||
| 1 | +.PHONY: paper reproduce-analysis test clean-paper | |
| 2 | +PY=.venv/bin/python | |
| 3 | +paper: | |
| 4 | + cd paper && latexmk -pdf -interaction=nonstopmode -halt-on-error main.tex >/dev/null && cp main.pdf WP30_Boucher_Cache_Compression_Knowledge_Transfer.pdf && echo "paper/WP30_Boucher_Cache_Compression_Knowledge_Transfer.pdf" | |
| 5 | +reproduce-analysis: | |
| 6 | + $(PY) -m wp30 analyze --protocol protocol/frozen.json && $(PY) -m wp30.analysis.static_tables && $(PY) -m wp30 audit-artifacts --root . | |
| 7 | +test: | |
| 8 | + $(PY) -m pytest -q | |
| 9 | +clean-paper: | |
| 10 | + cd paper && latexmk -C >/dev/null; rm -f paper/*.bbl paper/*.run.xml | |
added
README.md
+51 −0
@@ -0,0 +1,51 @@ | ||
| 1 | +<!-- Author: Simon-Pierre Boucher — simon-pierre.boucher@uqo.ca --> | |
| 2 | +# 🧠 Beyond Text: Cache Compression and Knowledge Transfer in Multi-Agent Systems | |
| 3 | + | |
| 4 | +**UQO Working Paper No. 30** — *A Reproducible Study of Fidelity, Communication Cost, and Repeated Handoffs* | |
| 5 | + | |
| 6 | +> **TL;DR** — Under which task, model, cache, network and reuse conditions does each communication representation (raw text, | |
| 7 | +> summaries, structured evidence, lossless codecs, learned prompt compression, native/quantized/evicted KV caches, learned cache | |
| 8 | +> mappings) preserve useful information at the lowest *measured* end-to-end cost? Real experiments on Apple Silicon (MLX) with | |
| 9 | +> Qwen2.5-3B / Llama-3.2-3B, genuine two-node cache transfer over a 1 GbE LAN, repeated-handoff chains with an evaluator-only | |
| 10 | +> fact ledger, fan-in with conflicting evidence, a same-family learned KV mapper, hosted-API receivers, and a development-fitted router. | |
| 11 | + | |
| 12 | +## 📌 Status | |
| 13 | +See `STATUS.md` (phase gates), `DECISIONS.md` (dated decisions), `FINAL_REPORT.md` (completion status and limitations). | |
| 14 | + | |
| 15 | +## 🗂 Repository layout | |
| 16 | +``` | |
| 17 | +protocol/ hypotheses.md (registered), analysis_plan.md, frozen.json (protocol hash), run matrices | |
| 18 | +literature/ sources.csv (34 verified sources), audit_group{1,2,3}.md, method_notes.md | |
| 19 | +configs/ models, data, resources (budgets/timeouts), pilot/core experiment configs | |
| 20 | +src/wp30/ backends (MLX), cache adapters (sparse/quantized/serialize/selection), methods (A0–A8), runner, chains, fanin, | |
| 21 | + transport (two-node worker), hosted (API track), mapper (Track C), router (E8), analysis, CLI | |
| 22 | +tests/ cache correctness (12), leakage (3), scoring/data (5) | |
| 23 | +data/ manifests (splits, licences), generated/docs (agent-visible), generated/keys (evaluator-only), raw/longbench | |
| 24 | +runs/raw per-attempt JSONL records (schema wp30-attempt-1), chains/ hop messages ; runs/logs ; runs/checkpoints (mapper, router) | |
| 25 | +results/ tables/ figures/ provenance.json claim_ledger.csv | |
| 26 | +paper/ LaTeX source + compiled PDF | |
| 27 | +reproduction/ requirements-lock.txt, minimal.yaml, report.json | |
| 28 | +``` | |
| 29 | + | |
| 30 | +## 🚀 Quick start (analysis-only reproduction, no inference) | |
| 31 | +```bash | |
| 32 | +uv venv --python 3.12 .venv && source .venv/bin/activate && uv pip install -r reproduction/requirements-lock.txt && uv pip install -e . | |
| 33 | +make reproduce-analysis # rebuilds results/tables and results/figures from runs/raw | |
| 34 | +make paper # compiles paper/main.pdf | |
| 35 | +``` | |
| 36 | + | |
| 37 | +## 🔁 Inference reproduction (Apple Silicon, ~15 GB of checkpoints from Hugging Face `mlx-community`) | |
| 38 | +```bash | |
| 39 | +python -m wp30 doctor --output evidence/environment.json | |
| 40 | +python -m wp30 data prepare --config configs/data.yaml && python -m wp30 data validate --manifest data/manifests/splits.json | |
| 41 | +python -m wp30 models probe --config configs/models.yaml | |
| 42 | +python -m pytest -q # cache correctness suite runs a real 1.5B model | |
| 43 | +python -m wp30 run --config configs/core.yaml --resume | |
| 44 | +python -m wp30 reproduce --profile reproduction/minimal.yaml | |
| 45 | +``` | |
| 46 | +Two-node experiments need a second Mac with the same checkpoint revision: `python -m wp30 worker --port 9430 --model <repo>` on the | |
| 47 | +receiver node, then `python scripts/e6_network.py --host <ip> ...` on the sender node. Hosted-API experiments need `ANTHROPIC_API_KEY` | |
| 48 | +/ `OPENAI_API_KEY` and are capped by `configs/resources.yaml`. | |
| 49 | + | |
| 50 | +## 📄 Citation | |
| 51 | +Boucher, S.-P. (2026). *Beyond Text: Cache Compression and Knowledge Transfer in Multi-Agent Systems*. UQO Working Paper No. 30. | |
added
configs/chains_core.yaml
+15 −0
@@ -0,0 +1,15 @@ | ||
| 1 | +experiment_id: E4_core | |
| 2 | +splits: [test] | |
| 3 | +lengths: [2000, 8000] | |
| 4 | +limit_docs: 20 | |
| 5 | +hops: [1, 2, 4, 8] | |
| 6 | +budget_tokens: 512 | |
| 7 | +max_fetch_bytes: 1500 | |
| 8 | +max_lookups: 4 | |
| 9 | +chains: | |
| 10 | + - {representation: A4, mode: closed, agents: [qwen3b]} | |
| 11 | + - {representation: A5, mode: closed, agents: [qwen3b]} | |
| 12 | + - {representation: A4, mode: repairable, agents: [qwen3b]} | |
| 13 | + - {representation: A5, mode: repairable, agents: [qwen3b]} | |
| 14 | + - {representation: A4, mode: closed, agents: [qwen3b, llama3b]} | |
| 15 | + - {representation: A5, mode: closed, agents: [qwen3b, llama3b]} | |
added
configs/chains_pilot.yaml
+13 −0
@@ -0,0 +1,13 @@ | ||
| 1 | +experiment_id: E4_pilot | |
| 2 | +splits: [dev] | |
| 3 | +lengths: [2000, 8000] | |
| 4 | +limit_docs: 6 | |
| 5 | +hops: [1, 2, 4] | |
| 6 | +budget_tokens: 512 | |
| 7 | +max_fetch_bytes: 1500 | |
| 8 | +max_lookups: 4 | |
| 9 | +chains: | |
| 10 | + - {representation: A4, mode: closed, agents: [qwen3b]} | |
| 11 | + - {representation: A5, mode: closed, agents: [qwen3b]} | |
| 12 | + - {representation: A4, mode: repairable, agents: [qwen3b]} | |
| 13 | + - {representation: A5, mode: repairable, agents: [qwen3b]} | |
added
configs/core.yaml
+35 −0
@@ -0,0 +1,35 @@ | ||
| 1 | +# Confirmatory single-handoff campaign (E1/E2-process/E3-text). Locked test split. Fixed before any test outcome was examined. | |
| 2 | +experiment_id: E1_core | |
| 3 | +splits: [test] | |
| 4 | +families: [synthetic, exec, public_qasper, public_2wikimqa] | |
| 5 | +lengths: [2000, 8000, 16000] | |
| 6 | +limit_docs_per_family: 40 # synthetic/exec test = all 40; public: first 40 test docs in manifest (hash) order | |
| 7 | +max_questions_per_doc: 5 # synthetic: 5 of 15 question types per document (first five in generator order) | |
| 8 | +model_pairs: | |
| 9 | + - {sender: qwen3b, receiver: qwen3b} | |
| 10 | + - {sender: llama3b, receiver: llama3b} | |
| 11 | +generation: {max_tokens: 48, per_family: {exec: 320}} | |
| 12 | +seeds: [0] | |
| 13 | +conditions: | |
| 14 | + - {method: A0} | |
| 15 | + - {method: A1} | |
| 16 | + - {method: A2, budget_tokens: 512} | |
| 17 | + - {method: A3, budget_tokens: 512, access: blind} | |
| 18 | + - {method: A3, budget_tokens: 512, access: aware} | |
| 19 | + - {method: A4, budget_tokens: 512, access: blind} | |
| 20 | + - {method: A4, budget_tokens: 512, access: aware, families: [synthetic]} | |
| 21 | + - {method: A5, budget_tokens: 512, access: blind} | |
| 22 | + - {method: A5, budget_tokens: 512, access: aware, families: [synthetic]} | |
| 23 | + - {method: A6, budget_tokens: 512, access: blind, max_fetch_bytes: 2000, max_lookups: 6} | |
| 24 | + - {method: A7, codec: zstd} | |
| 25 | + - {method: A8, budget_tokens: 512, access: blind} | |
| 26 | + - {method: B0} | |
| 27 | + - {method: B1} | |
| 28 | + - {method: B2, bits: 8} | |
| 29 | + - {method: B2, bits: 4} | |
| 30 | + - {method: B3, keep_frac: 0.25} | |
| 31 | + - {method: B4, keep_frac: 0.25} | |
| 32 | + - {method: B5, keep_frac: 0.25, access: aware} | |
| 33 | + - {method: B5, keep_frac: 0.25, access: blind} | |
| 34 | + - {method: B6, keep_frac: 0.25, access: aware} | |
| 35 | + - {method: B9, keep_frac: 0.25, bits: 8, access: aware, policy: attention} | |
added
configs/core_sender_alone.yaml
+14 −0
@@ -0,0 +1,14 @@ | ||
| 1 | +# Sender-alone reference for E3 (Qwen2.5-1.5B answering with full context) on the same items. | |
| 2 | +experiment_id: E3_core_sender | |
| 3 | +splits: [test] | |
| 4 | +families: [synthetic, exec] | |
| 5 | +lengths: [2000, 8000] | |
| 6 | +limit_docs_per_family: null | |
| 7 | +max_questions_per_doc: 8 | |
| 8 | +model_pairs: | |
| 9 | + - {sender: qwen1b5, receiver: qwen1b5} | |
| 10 | +generation: {max_tokens: 48, per_family: {exec: 320}} | |
| 11 | +seeds: [0] | |
| 12 | +conditions: | |
| 13 | + - {method: A1} | |
| 14 | + - {method: B0} | |
added
configs/core_transfer.yaml
+18 −0
@@ -0,0 +1,18 @@ | ||
| 1 | +# Track C confirmatory: same-family size ladder Qwen2.5-1.5B -> Qwen2.5-3B (shared tokenizer). Test split, synthetic + exec. | |
| 2 | +experiment_id: E3_core | |
| 3 | +splits: [test] | |
| 4 | +families: [synthetic, exec] | |
| 5 | +lengths: [2000, 8000] | |
| 6 | +limit_docs_per_family: null | |
| 7 | +max_questions_per_doc: 8 | |
| 8 | +model_pairs: | |
| 9 | + - {sender: qwen1b5, receiver: qwen3b} | |
| 10 | +generation: {max_tokens: 48, per_family: {exec: 320}} | |
| 11 | +seeds: [0] | |
| 12 | +conditions: | |
| 13 | + - {method: A1} # receiver alone, full context (reference) | |
| 14 | + - {method: A4, budget_tokens: 512, access: blind} # sender-generated summary -> receiver | |
| 15 | + - {method: A5, budget_tokens: 512, access: blind} | |
| 16 | + - {method: C0} # identity negative control | |
| 17 | + - {method: C2, mapper: runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz} | |
| 18 | + - {method: C3, mapper: runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz, keep_frac: 0.25, access: aware} | |
added
configs/fanin_core.yaml
+9 −0
@@ -0,0 +1,9 @@ | ||
| 1 | +experiment_id: E5_core | |
| 2 | +splits: [test] | |
| 3 | +lengths: [2000, 8000] | |
| 4 | +limit_docs: 20 | |
| 5 | +fan_in: [2, 4] | |
| 6 | +budget_tokens: 512 | |
| 7 | +sender: qwen3b | |
| 8 | +aggregator: qwen3b | |
| 9 | +methods: [full_context, concat_A4, merge_A5, shared_memory_A6, cache_concat_negative_control] | |
added
configs/hosted_core.yaml
+15 −0
@@ -0,0 +1,15 @@ | ||
| 1 | +experiment_id: ED_hosted_core | |
| 2 | +splits: [test] | |
| 3 | +families: [synthetic, exec, public_qasper] | |
| 4 | +lengths: [2000, 8000] | |
| 5 | +limit_docs_per_family: 8 | |
| 6 | +max_questions_per_doc: 5 | |
| 7 | +sender: qwen3b | |
| 8 | +providers: [anthropic, openai] | |
| 9 | +conditions: | |
| 10 | + - {method: A0} | |
| 11 | + - {method: A1} | |
| 12 | + - {method: A1, provider_cache: true} | |
| 13 | + - {method: A4, budget_tokens: 512, access: blind} | |
| 14 | + - {method: A5, budget_tokens: 512, access: blind} | |
| 15 | + - {method: A6, budget_tokens: 512, access: blind, max_fetch_bytes: 2000, max_lookups: 6} | |
added
configs/hosted_pilot.yaml
+14 −0
@@ -0,0 +1,14 @@ | ||
| 1 | +experiment_id: ED_hosted_pilot | |
| 2 | +splits: [dev] | |
| 3 | +families: [synthetic, exec, public_qasper] | |
| 4 | +lengths: [2000, 8000] | |
| 5 | +limit_docs_per_family: 2 | |
| 6 | +max_questions_per_doc: 5 | |
| 7 | +sender: qwen3b | |
| 8 | +providers: [anthropic, openai] | |
| 9 | +conditions: | |
| 10 | + - {method: A0} | |
| 11 | + - {method: A1} | |
| 12 | + - {method: A1, provider_cache: true} | |
| 13 | + - {method: A4, budget_tokens: 512, access: blind} | |
| 14 | + - {method: A5, budget_tokens: 512, access: blind} | |
added
configs/literature.yaml
+3 −0
@@ -0,0 +1,3 @@ | ||
| 1 | +sources_csv: literature/sources.csv | |
| 2 | +audits: [literature/audit_group1.md, literature/audit_group2.md, literature/audit_group3.md] | |
| 3 | +bib_out: paper/references.bib | |
added
configs/mapper.yaml
+6 −0
@@ -0,0 +1,6 @@ | ||
| 1 | +sender: qwen1b5 | |
| 2 | +receiver: qwen3b | |
| 3 | +families: [synthetic, exec] | |
| 4 | +max_tokens_per_doc: 8192 | |
| 5 | +ridge: 1.0 | |
| 6 | +n_dev_eval: 4 | |
modified
configs/pilot.yaml
+2 −2
@@ -2,8 +2,8 @@ experiment_id: E1_pilot | ||
| 2 | 2 | splits: [dev] |
| 3 | 3 | families: [synthetic, exec, public_qasper, public_2wikimqa] |
| 4 | 4 | lengths: [2000, 8000] |
| 5 | −limit_docs_per_family: 6 | |
| 6 | −max_questions_per_doc: 8 | |
| 5 | +limit_docs_per_family: 4 | |
| 6 | +max_questions_per_doc: 5 | |
| 7 | 7 | model_pairs: |
| 8 | 8 | - {sender: qwen3b, receiver: qwen3b} |
| 9 | 9 | - {sender: llama3b, receiver: llama3b} |
added
literature/method_notes.md
+75 −0
@@ -0,0 +1,75 @@ | ||
| 1 | +# WP30 method implementation notes (one entry per named method) | |
| 2 | + | |
| 3 | +Fidelity labels: **official** (upstream code/checkpoint run as released), **faithful_reimplementation** (algorithm re-implemented | |
| 4 | +from the paper/code with the same rule and defaults), **adapted** (algorithm changed to fit our setting; differences listed), | |
| 5 | +**inspired** (shares the idea, not the algorithm), **custom** (WP30 baseline with no published counterpart claimed). | |
| 6 | + | |
| 7 | +## A4 abstractive summary — custom | |
| 8 | +Sender = same checkpoint as receiver (or the configured sender), greedy decoding, prompt `SUMMARY_SYSTEM`/`summary_user` | |
| 9 | +(`src/wp30/prompts.py`), hard output cap = budget tokens. Question-blind variant never sees the question; question-aware appends it. | |
| 10 | +Measured: sender input/output tokens, generation time, UTF-8 bytes of the summary; receiver tokens of the summary under its own tokenizer. | |
| 11 | + | |
| 12 | +## A5 structured evidence — custom | |
| 13 | +Same sender/budget as A4; output = JSON {facts:[{entity, attribute, value, quote}], notes?, unknowns?}. Each quote is resolved to a | |
| 14 | +character span of the source (`doc.find`); unresolved quotes are counted (`unresolved_quotes`). The receiver sees the JSON with spans | |
| 15 | +(not the quotes) — values are transmitted, spans are provenance. Truncated JSON is repaired at the last complete object. | |
| 16 | + | |
| 17 | +## A6 references + metered retrieval — custom | |
| 18 | +Message = reference index {ref, entity, attribute, span} derived from A5 with values removed. Receiver side: BM25 of the question over | |
| 19 | +the labels, fetch up to `max_lookups` spans (±40/160 chars) under `max_fetch_bytes`; every fetched byte and lookup is recorded. | |
| 20 | + | |
| 21 | +## A7 lossless transport codec — custom (zstd level 3 / gzip 6) | |
| 22 | +Compress UTF-8 text for transport, decompress at the receiver; receiver prefill unchanged. Measured codec times and bytes. | |
| 23 | + | |
| 24 | +## A8 LLMLingua-2 — official | |
| 25 | +`llmlingua` 0.2.2, `PromptCompressor(model_name="microsoft/llmlingua-2-xlm-roberta-large-meetingbank", use_llmlingua2=True, device_map="mps")`, | |
| 26 | +`compress_prompt(doc, rate=budget/source_tokens, force_tokens=["\n",".",",",":","-"], drop_consecutive=True)`. Token classification is | |
| 27 | +question-agnostic (question-blind by construction). The upstream paper evaluated MeetingBank/LongBench/ZeroScrolls/GSM8K/BBH with | |
| 28 | +GPT-3.5/Mistral-7B receivers at 2x–5x rates; our receivers are 3B models. Backend: torch 2.15 on MPS (fp32); timing reported separately | |
| 29 | +because it is a different accelerator path than MLX. | |
| 30 | + | |
| 31 | +## B2 packed KV quantization — custom (mlx_lm primitives) | |
| 32 | +`mx.quantize(K|V, group_size=g, bits=b)` along the head dimension (per token, per group of g channels), asymmetric affine (scale + bias per | |
| 33 | +group), packed into uint32 words; consumed by `quantized_scaled_dot_product_attention` (quantized execution, no dequantized dense copy). | |
| 34 | +Bits ∈ {8, 4, 2}; group 64 (32 for 2-bit). Differences vs KIVI: KIVI quantizes keys per *channel* (over tokens) and values per token, with a | |
| 35 | +full-precision residual window (R = 128) and CUDA kernels; our scheme is the mlx_lm layout (per-token for both). The KIVI motivation | |
| 36 | +(outlier key channels) predicts exactly the Qwen2.5 failure we observe at 4 bits. | |
| 37 | + | |
| 38 | +## B3 sink + recent retention — inspired (StreamingLLM) | |
| 39 | +Keep the first `sinks=4` positions plus the most recent positions up to the budget. StreamingLLM re-assigns positions *within the cache* | |
| 40 | +(keys stored un-rotated, rotated at use with arange(kv_len)); WP30 keeps original positions (keys are stored post-RoPE in mlx_lm) and | |
| 41 | +preserves the logical offset, so new tokens see a positional gap. This is a retention *pattern* test, not a StreamingLLM reproduction | |
| 42 | +(and StreamingLLM makes no claim about retrieving evicted facts). | |
| 43 | + | |
| 44 | +## B4 random retention — custom control | |
| 45 | +Uniformly random positions (seeded) at the same budget; no sinks. | |
| 46 | + | |
| 47 | +## B5 attention-informed selection — faithful_reimplementation (SnapKV rule) | |
| 48 | +Observation window = last W prompt tokens (question-aware: the fresh query tokens; question-blind: a generic 32-token instruction); | |
| 49 | +per kv-head attention of the window queries onto prefix keys (softmax, averaged over window queries and over the query heads of the | |
| 50 | +GQA group), 1-D max-pooling with kernel 7 along positions, top-k per kv-head; the window itself is always retained (`window_keep=32`). | |
| 51 | +Differences: SnapKV runs inside the prefill kernel (prompt phase) with window 32/64 and kernel 5–13 depending on config; we compute the | |
| 52 | +window queries in a separate forward pass over a *copy* of the cache (cost recorded as `compress_ms`), so the main attention kernel | |
| 53 | +remains fused. Per-head retention produces per-head index sets (the SparseKVCache gathers per head). | |
| 54 | + | |
| 55 | +## B6 layer-dependent (pyramid) budgets — faithful_reimplementation of the PyramidKV budget rule | |
| 56 | +Budget per layer from KVCache-Factory: base = cap − window; min = base // β (β = 20); max = 2·base − min; step = (max − min)/(L − 1); | |
| 57 | +budget_l = max − l·step (+ window), rescaled to preserve the total budget exactly. Selection within a layer = B5 scoring. Because retained | |
| 58 | +lengths differ across layers, multi-token query prefill is executed token by token (mask-free); recorded as `sequential_query_prefill`. | |
| 59 | + | |
| 60 | +## B9 selection + quantization — custom composition | |
| 61 | +B5 (or B3) selection first, then B2 packing of the retained tensors (order: select → quantize). | |
| 62 | + | |
| 63 | +## C2 linear KV mapper — custom (not SwaT) | |
| 64 | +See `src/wp30/mapper.py`: per receiver layer, ridge regression from the aligned sender layer's un-rotated [K, V] (512 + bias) to the | |
| 65 | +receiver's un-rotated [K, V] (512); fitted on train-split caches only; re-rotated with the receiver's RoPE. Reconstruction-only loss. | |
| 66 | +SwaT trains a ~300M-parameter mapper with task/distillation terms on Granite→SmolLM; no checkpoint or licence is public (audit_group1). | |
| 67 | + | |
| 68 | +## C0 identity transfer — negative control | |
| 69 | +Sender K/V fed as receiver cache (shapes coincide: 2 × 128). Diagnostic of "shape match ≠ compatibility". | |
| 70 | + | |
| 71 | +## Methods audited but not executed | |
| 72 | +H2O (needs accumulated attention during prefill — would disable the fused kernel for the whole prefill), Attention Matching compaction | |
| 73 | +(official code pins vLLM 0.11/CUDA; a faithful MLX re-implementation of the optimization was out of scope — see coverage table), | |
| 74 | +C2C (official fuser checkpoints exist only for Qwen3 receivers, CUDA; receiver still prefills the source), LatentMAS (CUDA/vLLM, same-architecture | |
| 75 | +agents), SwaT (no checkpoint, no licence). | |
added
paper/.latexmkrc
+5 −0
@@ -0,0 +1,5 @@ | ||
| 1 | +$pdf_mode = 1; | |
| 2 | +$pdflatex = 'pdflatex -interaction=nonstopmode -halt-on-error -synctex=1 %O %S'; | |
| 3 | +$bibtex_use = 2; | |
| 4 | +$clean_ext = 'synctex.gz run.xml bbl bcf fdb_latexmk fls log aux out toc lof lot blg'; | |
| 5 | +@default_files = ('main.tex'); | |
added
paper/Makefile
+11 −0
@@ -0,0 +1,11 @@ | ||
| 1 | +.PHONY: all clean distclean | |
| 2 | + | |
| 3 | +all: | |
| 4 | + latexmk | |
| 5 | + | |
| 6 | +clean: | |
| 7 | + latexmk -c | |
| 8 | + | |
| 9 | +distclean: | |
| 10 | + latexmk -C | |
| 11 | + rm -f *.synctex.gz *.run.xml *.bbl *.bcf | |
added
paper/main.tex
+138 −0
@@ -0,0 +1,138 @@ | ||
| 1 | +% ============================================================================ | |
| 2 | +% UQO Working Paper Template — Economics / Finance | |
| 3 | +% ============================================================================ | |
| 4 | +\documentclass[12pt,letterpaper]{article} | |
| 5 | + | |
| 6 | +% --- Encoding & Language --- | |
| 7 | +\usepackage[utf8]{inputenc} | |
| 8 | +\usepackage[T1]{fontenc} | |
| 9 | +\usepackage[english]{babel} | |
| 10 | + | |
| 11 | +% --- Page Layout --- | |
| 12 | +\usepackage[ | |
| 13 | + letterpaper, | |
| 14 | + top=1in, | |
| 15 | + bottom=1in, | |
| 16 | + left=1in, | |
| 17 | + right=1in | |
| 18 | +]{geometry} | |
| 19 | + | |
| 20 | +% --- Typography --- | |
| 21 | +\usepackage{mathptmx} % Times-like font (text + math) | |
| 22 | +\usepackage{microtype} % Improved typographic refinements | |
| 23 | +\usepackage{setspace} | |
| 24 | +\onehalfspacing % 1.5 line spacing | |
| 25 | + | |
| 26 | +% --- Math --- | |
| 27 | +\usepackage{amsmath,amssymb,amsthm} | |
| 28 | + | |
| 29 | +% --- Tables --- | |
| 30 | +\usepackage{booktabs} | |
| 31 | +\usepackage{tabularx} | |
| 32 | +\usepackage{multirow} | |
| 33 | +\usepackage{threeparttable} | |
| 34 | +\usepackage{siunitx} | |
| 35 | +\sisetup{ | |
| 36 | + input-symbols = {()}, | |
| 37 | + table-format = -1.3, | |
| 38 | + parse-numbers = false | |
| 39 | +} | |
| 40 | + | |
| 41 | +% --- Figures --- | |
| 42 | +\usepackage{graphicx} | |
| 43 | +\usepackage{subcaption} | |
| 44 | +\usepackage{float} | |
| 45 | + | |
| 46 | +% --- Colors & Links --- | |
| 47 | +\usepackage[dvipsnames]{xcolor} | |
| 48 | +\usepackage[ | |
| 49 | + colorlinks = true, | |
| 50 | + linkcolor = NavyBlue, | |
| 51 | + citecolor = NavyBlue, | |
| 52 | + urlcolor = NavyBlue, | |
| 53 | + breaklinks = true | |
| 54 | +]{hyperref} | |
| 55 | + | |
| 56 | +% --- Bibliography --- | |
| 57 | +\usepackage[authoryear,round,semicolon]{natbib} | |
| 58 | +\bibliographystyle{aer} | |
| 59 | + | |
| 60 | +% --- Captions --- | |
| 61 | +\usepackage[ | |
| 62 | + font = small, | |
| 63 | + labelfont = bf, | |
| 64 | + labelsep = period, | |
| 65 | + justification = justified, | |
| 66 | + singlelinecheck = false | |
| 67 | +]{caption} | |
| 68 | + | |
| 69 | +% --- Headers & Footers --- | |
| 70 | +\usepackage{fancyhdr} | |
| 71 | +\pagestyle{fancy} | |
| 72 | +\fancyhf{} | |
| 73 | +\renewcommand{\headrulewidth}{0pt} | |
| 74 | +\fancyfoot[C]{\thepage} | |
| 75 | + | |
| 76 | +% --- Section Formatting --- | |
| 77 | +\usepackage{titlesec} | |
| 78 | +\titleformat{\section}{\large\bfseries}{\thesection.}{0.5em}{} | |
| 79 | +\titleformat{\subsection}{\normalsize\bfseries}{\thesubsection.}{0.5em}{} | |
| 80 | +\titleformat{\subsubsection}{\normalsize\itshape}{\thesubsubsection.}{0.5em}{} | |
| 81 | + | |
| 82 | +% --- Appendix Support --- | |
| 83 | +\usepackage[toc,page]{appendix} | |
| 84 | + | |
| 85 | +% --- Misc --- | |
| 86 | +\usepackage{enumitem} | |
| 87 | +\setlist{nosep,leftmargin=*} | |
| 88 | + | |
| 89 | +% ============================================================================ | |
| 90 | +% ============================================================================ | |
| 91 | +% METADATA | |
| 92 | +% ============================================================================ | |
| 93 | +\usepackage{algorithm} | |
| 94 | +\usepackage{algpseudocode} | |
| 95 | +\usepackage{longtable} | |
| 96 | +\usepackage{array} | |
| 97 | +\usepackage{pdflscape} | |
| 98 | +\usepackage{adjustbox} | |
| 99 | +\newcommand{\WPnumber}{30} | |
| 100 | +\newcommand{\WPtitle}{Beyond Text: Cache Compression and Knowledge Transfer in Multi-Agent Systems} | |
| 101 | +\newcommand{\WPsubtitle}{A Reproducible Study of Fidelity, Communication Cost, and Repeated Handoffs} | |
| 102 | +\newcommand{\WPdate}{October 2026} | |
| 103 | +\newcommand{\WPversion}{1.0} | |
| 104 | +\input{sections/abstract_text} | |
| 105 | +\newcommand{\WPkeywords}{KV cache compression; cache reuse; multi-agent systems; knowledge transfer; prompt compression; structured evidence; reproducibility; Apple Silicon; MLX} | |
| 106 | +\newcommand{\WPjel}{C63, C88, D83, L86, O33} | |
| 107 | +\newcommand{\WPauthor}{Simon-Pierre Boucher} | |
| 108 | +\newcommand{\WPaffiliation}{% | |
| 109 | + Département des sciences administratives\\ | |
| 110 | + Université du Québec en Outaouais% | |
| 111 | +} | |
| 112 | +\newcommand{\WPemail}{simon-pierre.boucher@uqo.ca} | |
| 113 | +\newcommand{\WPaddress}{% | |
| 114 | + Gatineau -- Pavillon Alexandre-Taché\\ | |
| 115 | + 283, boulevard Alexandre-Taché\\ | |
| 116 | + Gatineau, Québec, Canada J9A 1L8% | |
| 117 | +} | |
| 118 | +\graphicspath{{figures/}} | |
| 119 | +\newcommand{\pp}{pp.} | |
| 120 | + | |
| 121 | +\begin{document} | |
| 122 | +\input{sections/titlepage} | |
| 123 | +\tableofcontents | |
| 124 | +\newpage | |
| 125 | +\input{sections/introduction} | |
| 126 | +\input{sections/related} | |
| 127 | +\input{sections/formulation} | |
| 128 | +\input{sections/methods} | |
| 129 | +\input{sections/protocol} | |
| 130 | +\input{sections/results} | |
| 131 | +\input{sections/adaptive} | |
| 132 | +\input{sections/limitations} | |
| 133 | +\input{sections/reproducibility} | |
| 134 | +\input{sections/conclusion} | |
| 135 | +\newpage | |
| 136 | +\bibliography{references} | |
| 137 | +\input{appendix/appendix} | |
| 138 | +\end{document} | |
added
paper/references.bib
+42 −0
@@ -0,0 +1,42 @@ | ||
| 1 | +% Generated by `python -m wp30 sources audit` from literature/sources.csv (verified 2026-10-29) + curated core entries. | |
| 2 | + | |
| 3 | +@misc{alabdulkareem2026swat, title={SwaT: Cross-Family KV Cache Transfer between Language Models}, author={Alabdulkareem, Abdulrahman and Tenison, Isabel and Zhang, Jun and Zhu, Yiyang and Katz, Boris and Gutfreund, Dan}, year={2026}, eprint={2610.15095}, archivePrefix={arXiv}, note={arXiv preprint, v1 (October 2026); repository Ar-Kareem/SwaT, no released checkpoint or licence (verified 2026-10-29)}} | |
| 4 | +@misc{zweiger2026compaction, title={Fast KV Compaction via Attention Matching}, author={Zweiger, Adam and Fu, Yilun and Guo, Han and Kim, Yoon}, year={2026}, eprint={2602.16284}, archivePrefix={arXiv}, note={arXiv preprint, v2 (May 2026); code adamzweiger/compaction, MIT}} | |
| 5 | +@inproceedings{fu2026c2c, title={Cache-to-Cache: Direct Semantic Communication Between Large Language Models}, author={Fu, Tianyu and others}, booktitle={International Conference on Learning Representations (ICLR)}, year={2026}, note={arXiv:2510.03215; code thu-nics/C2C, Apache-2.0; fuser checkpoints nics-efc/C2C\_Fuser}} | |
| 6 | +@inproceedings{zou2026latentmas, title={LatentMAS: Latent Collaboration in Multi-Agent Systems}, author={Zou, Jiaru and others}, booktitle={International Conference on Machine Learning (ICML)}, year={2026}, note={arXiv:2511.20639; code Gen-Verse/LatentMAS, Apache-2.0}} | |
| 7 | +@inproceedings{liu2024kivi, title={KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache}, author={Liu, Zirui and Yuan, Jiayi and Jin, Hongye and Zhong, Shaochen and Xu, Zhaozhuo and Braverman, Vladimir and Chen, Beidi and Hu, Xia}, booktitle={International Conference on Machine Learning (ICML)}, year={2024}, note={arXiv:2402.02750}} | |
| 8 | +@inproceedings{li2024snapkv, title={SnapKV: LLM Knows What You are Looking for Before Generation}, author={Li, Yuhong and Huang, Yingbing and Yang, Bowen and Venkitesh, Bharat and Locatelli, Acyr and Ye, Hanchen and Cai, Tianle and Lewis, Patrick and Chen, Deming}, booktitle={Advances in Neural Information Processing Systems (NeurIPS)}, year={2024}, note={arXiv:2404.14469; code FasterDecoding/SnapKV}} | |
| 9 | +@misc{cai2024pyramidkv, title={PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling}, author={Cai, Zefan and Zhang, Yichi and Gao, Bofei and Liu, Yuliang and Li, Yucheng and Liu, Tianyu and Lu, Keming and Xiong, Wayne and Dong, Yue and Hu, Junjie and Xiao, Wen}, year={2024}, eprint={2406.02069}, archivePrefix={arXiv}, note={v4 (May 2025); code Zefan-Cai/KVCache-Factory, MIT}} | |
| 10 | +@inproceedings{zhang2023h2o, title={H$_2$O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models}, author={Zhang, Zhenyu and Sheng, Ying and Zhou, Tianyi and Chen, Tianlong and Zheng, Lianmin and Cai, Ruisi and Song, Zhao and Tian, Yuandong and R{\'e}, Christopher and Barrett, Clark and Wang, Zhangyang and Chen, Beidi}, booktitle={Advances in Neural Information Processing Systems (NeurIPS)}, year={2023}, note={arXiv:2306.14048}} | |
| 11 | +@inproceedings{xiao2024streamingllm, title={Efficient Streaming Language Models with Attention Sinks}, author={Xiao, Guangxuan and Tian, Yuandong and Chen, Beidi and Han, Song and Lewis, Mike}, booktitle={International Conference on Learning Representations (ICLR)}, year={2024}, note={arXiv:2309.17453}} | |
| 12 | +@inproceedings{pan2024llmlingua2, title={LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression}, author={Pan, Zhuoshi and Wu, Qianhui and Jiang, Huiqiang and Xia, Menglin and Luo, Xufang and Zhang, Jue and Lin, Qingwei and R{\"u}hle, Victor and Yang, Yuqing and Lin, Chin-Yew and Zhao, H. Vicky and Qiu, Lili and Zhang, Dongmei}, booktitle={Findings of the Association for Computational Linguistics: ACL 2024}, year={2024}, note={arXiv:2403.12968}} | |
| 13 | +@inproceedings{bai2024longbench, title={LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding}, author={Bai, Yushi and Lv, Xin and Zhang, Jiajie and Lyu, Hongchang and Tang, Jiankai and Huang, Zhidian and Du, Zhengxiao and Liu, Xiao and Zeng, Aohan and Hou, Lei and Dong, Yuxiao and Tang, Jie and Li, Juanzi}, booktitle={Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)}, pages={3119--3137}, year={2024}, doi={10.18653/v1/2024.acl-long.172}} | |
| 14 | +@inproceedings{hsieh2024ruler, title={RULER: What's the Real Context Size of Your Long-Context Language Models?}, author={Hsieh, Cheng-Ping and Sun, Simeng and Kriman, Samuel and Acharya, Shantanu and Rekesh, Dima and Jia, Fei and Zhang, Yang and Ginsburg, Boris}, booktitle={First Conference on Language Modeling (COLM)}, year={2024}, note={arXiv:2404.06654}} | |
| 15 | +@misc{mlxlm2026, title={mlx-lm: Run LLMs with MLX}, author={{Apple ML Explore contributors}}, year={2026}, howpublished={\url{https://github.com/ml-explore/mlx-lm}}, note={v0.32.2 (16 October 2026), MIT}} | |
| 16 | +@misc{anthropic2026caching, title={Prompt caching}, author={{Anthropic}}, year={2026}, howpublished={\url{https://platform.claude.com/docs/en/build-with-claude/prompt-caching}}, note={accessed 2026-10-29}} | |
| 17 | +@misc{hf2026kvcache, title={KV cache strategies}, author={{Hugging Face}}, year={2026}, howpublished={\url{https://huggingface.co/docs/transformers/en/kv_cache}}, note={Transformers v5 documentation, accessed 2026-10-29}} | |
| 18 | +@misc{dasigi2021qasper, title={A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers}, author={Dasigi, Pradeep and Lo, Kyle and Beltagy, Iz and Cohan, Arman and Smith, Noah A. and Gardner, Matt}, year={2021}, note={NAACL 2021; QASPER, CC BY 4.0}} | |
| 19 | +@inproceedings{ho2020twowiki, title={Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Steps}, author={Ho, Xanh and Nguyen, Anh-Khoa Duong and Sugawara, Saku and Aizawa, Akiko}, booktitle={Proceedings of the 28th International Conference on Computational Linguistics (COLING)}, year={2020}} | |
| 20 | +@inproceedings{yang2018hotpotqa, title={HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering}, author={Yang, Zhilin and Qi, Peng and Zhang, Saizheng and Bengio, Yoshua and Cohen, William W. and Salakhutdinov, Ruslan and Manning, Christopher D.}, booktitle={EMNLP}, year={2018}} | |
| 21 | +@misc{qwen2.5, title={Qwen2.5 Technical Report}, author={{Qwen Team}}, year={2024}, eprint={2412.15115}, archivePrefix={arXiv}} | |
| 22 | +@misc{llama3, title={The Llama 3 Herd of Models}, author={{Llama Team, AI @ Meta}}, year={2024}, eprint={2407.21783}, archivePrefix={arXiv}} | |
| 23 | + | |
| 24 | +@misc{taekyung2026_heo2026, title={Cross-Model KV Cache Transfer in LLM Families: A Closed-Form Linear Mapping for Prefill Reuse}, author={Taekyung Heo; Rasoul Shafipour; Ritchie Zhao; Maximilian Golub; Mohammad Mahdi Kamani; Ritika Borkar; Makesh Tarun Chandran; Pantea Zardoshti; Bita Darvish Rouhani}, year={2026}, eprint={2608.03893}, archivePrefix={arXiv}, note={arXiv preprint; no venue stated; verification: arXiv export API metadata only (title/authors/dates/abstract); repo not checked}} | |
| 25 | +@misc{xingyu2026_qu2026, title={CacheBridge: Efficient Cross-Model KV Cache Transfer}, author={Xingyu Qu; Siyuan Lu; Zhiyu Chen; Sheng Wang; Tao Lin}, year={2026}, eprint={2609.00891}, archivePrefix={arXiv}, note={arXiv preprint; no venue stated; verification: arXiv export API metadata only}} | |
| 26 | +@misc{vincentdaniel2026_yun2026, title={Prefill-Free Cross-Family KV Cache Transfer for Heterogeneous Multi-Agent LLMs (HeteroFold)}, author={Vincent-Daniel Yun; Woosang Lim; Haneul Yoo; Sungjoo Yoo; Murali Annavaram; Sai Praneeth Karimireddy}, year={2026}, eprint={2609.32259}, archivePrefix={arXiv}, note={arXiv preprint; no venue stated; verification: arXiv export API metadata only}} | |
| 27 | +@misc{yi2026_li2026, title={A Universal Context-Reuse Layer for Cross-Model KV Sharing}, author={Yi Li; Dongming Jiang; Yi Zhao; Bingzhe Li}, year={2026}, eprint={2608.30963}, archivePrefix={arXiv}, note={arXiv preprint; no venue stated; verification: arXiv export API metadata only}} | |
| 28 | +@misc{xiangyu2025_shi2025, title={KVComm: Enabling Efficient LLM Communication through Selective KV Sharing}, author={Xiangyu Shi; Marco Chiesa; Gerald Q. Maguire; Dejan Kostic}, year={2025}, eprint={2510.03346}, archivePrefix={arXiv}, note={ICLR 2026 (arXiv Comments); verification: arXiv export API metadata only}} | |
| 29 | +@misc{hancheng2025_ye2025, title={KVCOMM: Online Cross-context KV-cache Communication for Efficient LLM-based Multi-agent Systems}, author={Hancheng Ye; Zhengqi Gao; Mingyuan Ma; Qinsi Wang; Yuzhe Fu; Ming-Yu Chung; Yueqian Lin; Zhijian Liu; Jianyi Zhang; Danyang Zhuo; Yiran Chen}, year={2025}, eprint={2510.12872}, archivePrefix={arXiv}, note={NeurIPS 2025 (arXiv Comments); verification: arXiv export API metadata only; repo URL from arXiv Comments, not fetched}} | |
| 30 | +@misc{yanwen2026_peng2026, title={StateBridge: Training-free Hidden-state Alignment for Latent Communication in LLM Multi-Agent Systems}, author={Yanwen Peng; Delvin Ce Zhang; Xi Wang; Nikolaos Aletras}, year={2026}, eprint={2608.13317}, archivePrefix={arXiv}, note={COLM 2026 (arXiv Comments; 18 pages); verification: arXiv export API metadata only}} | |
| 31 | +@misc{zhuoyun2025_du2025, title={Enabling Agents to Communicate Entirely in Latent Space (Interlat)}, author={Zhuoyun Du; Runze Wang; Huiyu Bai; Zouying Cao; Xiaoyong Zhu; Yu Cheng; Bo Zheng; Wei Chen; Haochao Ying}, year={2025}, eprint={2511.09149}, archivePrefix={arXiv}, note={Accepted to ACL 2026 (arXiv Comments); verification: arXiv export API metadata only}} | |
| 32 | +@misc{yuhan2024_liu2024, title={DroidSpeak: KV Cache Sharing for Cross-LLM Communication and Multi-LLM Serving}, author={Yuhan Liu; Yuyang Huang; Jiayi Yao; Shaoting Feng; Zhuohan Gu; Kuntai Du; Hanchen Li; Yihua Cheng; Junchen Jiang; Shan Lu; Madan Musuvathi; Esha Choukse}, year={2024}, eprint={2411.02820}, archivePrefix={arXiv}, note={arXiv; no venue in Comments (search snippet: NSDI 2026, unverified); verification: arXiv export API metadata only}} | |
| 33 | +@misc{yingzhuo2026_liu2026, title={Beyond tokens: a unified framework for latent communication in LLM-based multi-agent systems}, author={Yingzhuo Liu}, year={2026}, eprint={2606.05711}, archivePrefix={arXiv}, note={arXiv preprint (survey); no venue stated; verification: arXiv export API metadata only}} | |
| 34 | +@misc{simon2026_villani2026, title={LatentPort: Beyond KV Cache - Cross-Model Transfer of Recurrent Memory in Hybrid Language Models: A 4B-to-9B Hybrid-State Handoff Without Target Prefix Replay}, author={Simon P. Villani}, year={2026}, eprint={2609.25053}, archivePrefix={arXiv}, note={arXiv preprint (14 pages, Comments); verification: arXiv export API metadata only}} | |
| 35 | +@misc{zongqian2024_li2024, title={Prompt Compression for Large Language Models: A Survey}, author={Zongqian Li, Yinhong Liu, Yixuan Su, Nigel Collier}, year={2024}, eprint={2410.12388}, archivePrefix={arXiv}, note={arXiv (Comments empty); NAACL 2025 Long per search snippet (unverified); verification: arXiv page fetched; venue from search snippet only}} | |
| 36 | +@misc{yanyu2025_liu2025, title={KV Cache Compression for Inference Efficiency in LLMs: A Review}, author={Yanyu Liu, Jingying Fu, Sixiang Liu, Yitian Zou, You Fu, Jiehan Zhou, Shouhua Zhang}, year={2025}, eprint={2508.06297}, archivePrefix={arXiv}, note={arXiv preprint (Comments: 12 pages); verification: arXiv page fetched}} | |
| 37 | +@misc{neusha2025_javidnia2025, title={Key, Value, Compress: A Systematic Exploration of KV Cache Compression Techniques}, author={Neusha Javidnia, Bita Darvish Rouhani, Farinaz Koushanfar}, year={2025}, eprint={2503.11816}, archivePrefix={arXiv}, note={IEEE CICC 2025 (invited; arXiv Comments); verification: arXiv page fetched}} | |
| 38 | +@misc{wei2025_gao2025, title={Rethinking Key-Value Cache Compression Techniques for Large Language Model Serving}, author={Wei Gao, Xinyu Zhou, Peng Sun, Tianwei Zhang, Yonggang Wen}, year={2025}, eprint={2503.24000}, archivePrefix={arXiv}, note={MLSys 2025 (arXiv Comments); verification: arXiv page fetched}} | |
| 39 | +@misc{hancheng2025_ye2025, title={KVCOMM: Online Cross-context KV-cache Communication for Efficient LLM-based Multi-agent Systems}, author={Hancheng Ye, Zhengqi Gao, Mingyuan Ma, Qinsi Wang, Yuzhe Fu, Ming-Yu Chung, Yueqian Lin, Zhijian Liu, Jianyi Zhang, Danyang Zhuo, Yiran Chen}, year={2025}, eprint={2510.12872}, archivePrefix={arXiv}, note={NeurIPS 2025 (arXiv Comments: Accepted for publication in NeurIPS2025); verification: arXiv page fetched}} | |
| 40 | +@misc{zhuohang2026_bian2026, title={TokenDance: Scaling Multi-Agent LLM Serving via Collective KV Cache Sharing}, author={Zhuohang Bian, Feiyang Wu, Chengrui Zhang, Hangcheng Dong, Yun Liang, Youwei Zhuo}, year={2026}, eprint={2604.03143}, archivePrefix={arXiv}, note={arXiv preprint under review; verification: arXiv page fetched}} | |
| 41 | +@misc{hyesung2026_jeon2026, title={LRAgent: Efficient KV Cache Sharing for Multi-LoRA LLM Agents}, author={Hyesung Jeon, Hyeongju Ha, Jae-Joon Kim}, year={2026}, eprint={2602.01053}, archivePrefix={arXiv}, note={ICML 2026 Poster (arXiv journal-ref); verification: arXiv page fetched}} | |
| 42 | +@misc{yurui2026_chang2026, title={MemCollab: Cross-Model Memory Collaboration via Contrastive Trajectory Distillation}, author={Yurui Chang, Yiran Wu, Qingyun Wu, Lu Lin}, year={2026}, eprint={2603.23234}, archivePrefix={arXiv}, note={arXiv preprint (no venue stated); verification: arXiv page fetched}} | |
added
paper/sections/titlepage.tex
+77 −0
@@ -0,0 +1,77 @@ | ||
| 1 | +% ============================================================================ | |
| 2 | +% Title Page | |
| 3 | +% ============================================================================ | |
| 4 | +\thispagestyle{empty} | |
| 5 | + | |
| 6 | +\begin{center} | |
| 7 | + | |
| 8 | +% --- Logo --- | |
| 9 | +\includegraphics[width=3.5cm]{uq_logo.jpg} | |
| 10 | + | |
| 11 | +\vspace{0.6cm} | |
| 12 | + | |
| 13 | +{\footnotesize\textsc{Université du Québec en Outaouais}}\\[0.15cm] | |
| 14 | +{\footnotesize\textsc{Département des sciences administratives}} | |
| 15 | + | |
| 16 | +\vspace{0.8cm} | |
| 17 | + | |
| 18 | +{\footnotesize\textsc{Working Paper No.~\WPnumber}} | |
| 19 | + | |
| 20 | +\vspace{1.2cm} | |
| 21 | + | |
| 22 | +% --- Title --- | |
| 23 | +{\LARGE\bfseries \WPtitle\par} | |
| 24 | + | |
| 25 | +\ifx\WPsubtitle\empty\else | |
| 26 | + \vspace{0.3cm} | |
| 27 | + {\large\itshape \WPsubtitle\par} | |
| 28 | +\fi | |
| 29 | + | |
| 30 | +\vspace{1.2cm} | |
| 31 | + | |
| 32 | +% --- Author --- | |
| 33 | +{\large \WPauthor}\\[0.3cm] | |
| 34 | +{\normalsize \WPaffiliation}\\[0.15cm] | |
| 35 | +{\normalsize \href{mailto:\WPemail}{\WPemail}}\\[0.15cm] | |
| 36 | +{\small \WPaddress} | |
| 37 | + | |
| 38 | +\vspace{0.8cm} | |
| 39 | + | |
| 40 | +% --- Date & Version --- | |
| 41 | +{\normalsize \WPdate}\\[0.1cm] | |
| 42 | +{\small Version~\WPversion} | |
| 43 | + | |
| 44 | +\end{center} | |
| 45 | + | |
| 46 | +\vfill | |
| 47 | + | |
| 48 | +\newpage | |
| 49 | + | |
| 50 | +% ============================================================================ | |
| 51 | +% Abstract Page | |
| 52 | +% ============================================================================ | |
| 53 | +\thispagestyle{empty} | |
| 54 | + | |
| 55 | +\vspace*{1cm} | |
| 56 | + | |
| 57 | +\noindent\rule{\textwidth}{0.4pt} | |
| 58 | +\vspace{0.3cm} | |
| 59 | + | |
| 60 | +\noindent\textbf{Abstract} | |
| 61 | + | |
| 62 | +\vspace{0.15cm} | |
| 63 | + | |
| 64 | +\noindent\WPabstract | |
| 65 | + | |
| 66 | +\vspace{0.4cm} | |
| 67 | + | |
| 68 | +\noindent\textbf{Keywords:} \WPkeywords | |
| 69 | + | |
| 70 | +\vspace{0.15cm} | |
| 71 | + | |
| 72 | +\noindent\textbf{JEL Classification:} \WPjel | |
| 73 | + | |
| 74 | +\vspace{0.3cm} | |
| 75 | +\noindent\rule{\textwidth}{0.4pt} | |
| 76 | + | |
| 77 | +\newpage | |
added
paper/uq_logo.jpg
+0 −0
Binary file not shown.
added
protocol/analysis_plan.md
+18 −0
@@ -0,0 +1,18 @@ | ||
| 1 | +# WP30 statistical analysis plan (registered with the protocol freeze) | |
| 2 | + | |
| 3 | +- **Unit of analysis:** one (document, question, condition, model pair) trial. Documents are the independent clusters; all | |
| 4 | + questions of a document are dependent observations. | |
| 5 | +- **Quality endpoints:** synthetic/exec: `correct` ∈ {0,1} (exec graded by hidden tests: all-pass = 1; pass rate reported as | |
| 6 | + secondary); public QA: LongBench F1 (max over reference answers) with the LongBench normalization. | |
| 7 | + `quality_operational` sets failed/invalid attempts to 0 so that failures cannot vanish; conditional quality over successes is | |
| 8 | + reported separately. | |
| 9 | +- **Resource endpoints:** serialized payload bytes (measured), cache tensor bytes (measured), scenario latencies assembled from | |
| 10 | + recorded spans: cold = build + compress/serialize + load + receiver; warm per-query = load + receiver; amortized(N) = | |
| 11 | + build/N + warm; peak MLX memory (prefill and decode recorded separately). | |
| 12 | +- **Uncertainty:** document-level cluster bootstrap, 2 000 replicates, percentile 95 % intervals, for means and for paired | |
| 13 | + differences on identical instances. Bootstrap two-sided p-values for the registered primary family, Holm-corrected (6 tests, | |
| 14 | + `protocol/hypotheses.md`). Everything else is exploratory and labelled so. | |
| 15 | +- **Latency:** p50/p95 and means with sample counts; timing trials in the core run alone on the GPU (pilot timings excluded). | |
| 16 | +- **Failures:** operational success rate over all scheduled trials; categories success/invalid_output/timeout/oom/incompatible/ | |
| 17 | + implementation_error/unavailable/budget_exhausted; retries keep both attempts. | |
| 18 | +- **No test-set tuning:** prompts, budgets, selection hyper-parameters, and the router are fixed on dev before the core run. | |
added
protocol/core_matrix_draft.csv
+6561 −0
@@ -0,0 +1,6561 @@ | ||
| 1 | +experiment_id,condition,method,access,sender,receiver,family,document_id,split,target_tokens,n_questions,seed,expected_trials | |
| 2 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 3 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 4 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 5 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 6 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 7 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 8 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 9 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 10 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 11 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 12 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 13 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 14 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 15 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 16 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 17 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 18 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 19 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 20 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 21 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 22 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 23 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 24 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 25 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 26 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 27 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 28 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 29 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 30 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 31 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 32 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 33 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 34 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 35 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 36 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 37 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 38 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 39 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 40 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 41 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 42 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 43 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 44 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 45 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 46 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 47 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 48 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 49 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 50 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 51 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 52 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 53 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 54 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 55 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 56 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 57 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 58 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 59 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 60 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 61 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 62 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 63 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 64 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 65 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 66 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 67 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 68 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 69 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 70 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 71 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 72 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 73 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 74 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 75 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 76 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 77 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 78 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 79 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 80 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 81 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 82 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 83 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 84 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 85 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 86 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 87 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 88 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 89 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 90 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 91 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 92 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 93 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 94 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 95 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 96 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 97 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 98 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 99 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 100 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 101 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 102 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 103 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 104 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 105 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 106 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 107 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 108 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 109 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 110 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 111 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 112 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 113 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 114 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 115 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 116 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 117 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 118 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 119 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 120 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 121 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 122 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 123 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 124 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 125 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 126 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 127 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 128 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 129 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 130 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 131 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 132 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 133 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 134 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 135 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 136 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 137 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 138 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 139 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 140 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 141 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 142 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 143 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 144 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 145 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 146 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 147 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 148 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 149 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 150 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 151 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 152 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 153 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 154 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 155 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 156 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 157 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 158 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 159 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 160 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 161 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 162 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 163 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 164 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 165 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 166 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 167 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 168 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 169 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 170 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 171 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 172 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 173 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 174 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 175 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 176 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 177 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 178 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 179 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 180 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 181 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 182 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 183 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 184 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 185 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 186 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 187 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 188 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 189 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 190 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 191 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 192 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 193 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 194 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 195 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 196 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 197 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 198 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 199 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 200 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 201 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 202 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 203 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 204 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 205 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 206 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 207 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 208 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 209 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 210 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 211 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 212 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 213 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 214 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 215 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 216 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 217 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 218 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 219 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 220 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 221 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 222 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 223 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 224 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 225 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 226 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 227 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 228 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 229 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 230 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 231 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 232 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 233 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 234 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 235 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 236 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 237 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 238 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 239 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 240 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 241 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 242 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 243 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 244 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 245 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 246 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 247 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 248 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 249 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 250 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 251 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 252 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 253 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 254 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 255 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 256 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 257 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 258 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 259 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 260 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 261 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 262 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 263 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 264 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 265 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 266 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 267 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 268 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 269 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 270 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 271 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 272 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 273 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 274 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 275 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 276 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 277 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 278 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 279 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 280 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 281 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 282 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 283 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 284 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 285 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 286 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 287 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 288 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 289 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 290 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 291 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 292 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 293 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 294 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 295 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 296 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 297 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 298 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 299 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 300 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 301 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 302 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 303 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 304 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 305 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 306 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 307 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 308 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 309 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 310 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 311 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 312 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 313 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 314 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 315 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 316 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 317 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 318 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 319 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 320 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 321 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 322 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 323 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 324 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 325 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 326 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 327 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 328 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 329 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 330 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 331 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 332 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 333 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 334 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 335 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 336 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 337 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 338 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 339 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 340 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 341 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 342 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 343 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 344 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 345 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 346 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 347 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 348 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 349 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 350 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 351 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 352 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 353 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 354 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 355 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 356 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 357 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 358 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 359 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 360 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 361 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 362 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 363 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 364 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 365 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 366 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 367 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 368 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 369 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 370 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 371 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 372 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 373 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 374 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 375 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 376 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 377 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 378 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 379 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 380 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 381 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 382 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 383 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 384 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 385 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 386 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 387 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 388 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 389 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 390 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 391 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 392 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 393 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 394 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 395 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 396 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 397 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 398 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 399 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 400 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 401 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 402 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 403 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 404 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 405 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 406 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 407 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 408 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 409 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 410 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 411 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 412 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 413 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 414 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 415 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 416 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 417 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 418 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 419 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 420 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 421 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 422 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 423 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 424 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 425 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 426 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 427 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 428 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 429 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 430 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 431 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 432 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 433 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 434 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 435 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 436 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 437 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 438 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 439 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 440 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 441 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 442 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 443 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 444 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 445 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 446 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 447 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 448 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 449 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 450 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 451 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 452 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 453 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 454 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 455 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 456 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 457 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 458 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 459 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 460 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 461 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 462 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 463 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 464 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 465 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 466 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 467 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 468 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 469 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 470 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 471 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 472 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 473 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 474 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 475 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 476 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 477 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 478 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 479 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 480 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 481 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 482 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 483 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 484 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 485 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 486 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 487 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 488 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 489 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 490 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 491 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 492 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 493 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 494 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 495 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 496 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 497 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 498 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 499 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 500 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 501 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 502 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 503 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 504 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 505 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 506 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 507 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 508 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 509 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 510 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 511 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 512 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 513 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 514 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 515 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 516 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 517 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 518 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 519 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 520 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 521 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 522 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 523 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 524 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 525 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 526 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 527 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 528 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 529 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 530 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 531 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 532 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 533 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 534 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 535 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 536 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 537 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 538 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 539 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 540 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 541 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 542 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 543 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 544 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 545 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 546 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 547 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 548 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 549 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 550 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 551 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 552 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 553 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 554 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 555 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 556 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 557 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 558 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 559 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 560 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 561 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 562 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 563 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 564 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 565 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 566 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 567 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 568 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 569 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 570 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 571 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 572 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 573 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 574 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 575 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 576 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 577 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 578 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 579 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 580 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 581 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 582 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 583 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 584 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 585 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 586 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 587 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 588 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 589 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 590 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 591 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 592 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 593 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 594 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 595 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 596 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 597 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 598 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 599 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 600 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 601 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 602 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 603 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 604 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 605 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 606 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 607 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 608 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 609 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 610 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 611 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 612 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 613 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 614 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 615 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 616 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 617 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 618 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 619 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 620 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 621 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 622 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 623 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 624 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 625 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 626 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 627 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 628 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 629 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 630 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 631 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 632 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 633 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 634 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 635 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 636 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 637 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 638 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 639 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 640 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 641 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 642 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 643 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 644 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 645 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 646 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 647 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 648 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 649 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 650 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 651 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 652 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 653 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 654 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 655 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 656 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 657 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 658 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 659 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 660 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 661 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 662 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 663 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 664 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 665 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 666 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 667 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 668 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 669 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 670 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 671 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 672 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 673 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 674 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 675 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 676 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 677 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 678 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 679 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 680 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 681 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 682 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 683 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 684 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 685 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 686 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 687 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 688 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 689 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 690 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 691 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 692 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 693 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 694 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 695 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 696 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 697 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 698 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 699 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 700 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 701 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 702 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 703 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 704 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 705 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 706 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 707 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 708 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 709 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 710 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 711 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 712 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 713 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 714 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 715 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 716 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 717 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 718 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 719 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 720 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 721 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 722 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 723 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 724 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 725 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 726 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 727 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 728 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 729 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 730 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 731 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 732 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 733 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 734 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 735 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 736 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 737 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 738 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 739 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 740 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 741 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 742 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 743 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 744 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 745 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 746 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 747 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 748 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 749 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 750 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 751 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 752 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 753 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 754 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 755 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 756 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 757 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 758 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 759 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 760 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 761 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 762 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 763 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 764 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 765 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 766 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 767 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 768 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 769 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 770 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 771 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 772 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 773 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 774 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 775 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 776 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 777 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 778 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 779 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 780 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 781 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 782 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 783 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 784 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 785 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 786 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 787 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 788 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 789 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 790 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 791 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 792 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 793 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 794 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 795 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 796 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 797 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 798 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 799 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 800 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 801 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 802 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 803 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 804 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 805 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 806 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 807 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 808 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 809 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 810 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 811 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 812 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 813 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 814 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 815 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 816 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 817 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 818 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 819 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 820 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 821 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 822 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 823 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 824 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 825 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 826 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 827 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 828 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 829 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 830 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 831 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 832 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 833 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 834 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 835 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 836 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 837 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 838 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 839 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 840 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 841 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 842 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 843 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 844 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 845 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 846 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 847 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 848 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 849 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 850 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 851 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 852 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 853 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 854 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 855 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 856 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 857 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 858 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 859 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 860 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 861 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 862 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 863 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 864 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 865 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 866 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 867 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 868 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 869 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 870 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 871 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 872 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 873 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 874 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 875 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 876 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 877 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 878 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 879 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 880 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 881 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 882 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 883 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 884 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 885 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 886 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 887 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 888 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 889 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 890 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 891 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 892 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 893 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 894 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 895 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 896 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 897 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 898 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 899 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 900 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 901 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 902 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 903 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 904 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 905 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 906 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 907 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 908 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 909 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 910 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 911 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 912 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 913 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 914 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 915 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 916 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 917 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 918 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 919 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 920 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 921 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 922 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 923 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 924 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 925 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 926 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 927 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 928 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 929 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 930 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 931 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 932 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 933 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 934 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 935 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 936 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 937 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 938 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 939 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 940 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 941 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 942 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 943 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 944 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 945 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 946 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 947 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 948 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 949 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 950 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 951 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 952 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 953 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 954 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 955 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 956 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 957 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 958 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 959 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 960 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 961 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 962 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 963 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 964 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 965 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 966 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 967 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 968 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 969 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 970 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 971 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 972 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 973 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 974 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 975 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 976 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 977 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 978 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 979 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 980 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 981 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 982 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 983 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 984 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 985 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 986 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 987 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 988 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 989 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 990 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 991 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 992 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 993 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 994 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 995 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 996 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 997 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 998 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 999 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1000 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1001 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1002 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1003 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1004 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1005 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1006 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1007 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1008 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1009 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1010 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1011 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1012 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1013 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1014 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1015 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1016 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1017 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1018 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1019 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1020 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1021 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1022 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1023 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1024 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1025 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1026 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1027 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1028 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1029 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1030 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1031 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1032 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1033 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1034 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1035 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1036 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1037 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1038 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1039 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1040 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1041 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1042 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1043 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1044 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1045 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1046 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1047 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1048 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1049 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1050 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1051 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1052 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1053 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1054 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1055 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1056 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1057 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1058 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1059 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1060 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1061 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1062 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1063 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1064 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1065 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1066 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1067 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1068 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1069 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1070 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1071 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1072 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1073 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1074 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1075 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1076 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1077 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1078 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1079 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1080 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1081 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1082 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1083 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1084 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1085 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1086 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1087 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1088 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1089 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1090 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1091 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1092 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1093 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1094 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1095 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1096 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1097 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1098 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1099 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1100 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1101 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1102 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1103 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1104 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1105 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1106 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1107 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1108 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1109 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1110 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1111 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1112 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1113 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1114 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1115 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1116 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1117 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1118 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1119 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1120 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1121 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1122 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1123 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1124 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1125 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1126 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1127 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1128 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1129 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1130 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1131 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1132 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1133 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1134 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1135 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1136 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1137 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1138 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1139 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1140 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1141 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1142 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1143 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1144 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1145 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1146 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1147 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1148 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1149 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1150 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1151 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1152 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1153 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1154 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1155 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1156 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1157 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1158 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1159 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1160 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1161 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1162 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1163 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1164 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1165 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1166 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1167 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1168 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1169 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1170 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1171 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1172 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1173 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1174 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1175 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1176 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1177 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1178 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1179 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1180 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1181 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1182 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1183 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1184 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1185 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1186 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1187 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1188 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1189 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1190 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1191 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1192 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1193 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1194 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1195 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1196 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1197 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1198 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1199 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1200 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1201 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1202 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1203 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1204 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1205 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1206 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1207 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1208 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1209 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1210 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1211 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1212 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1213 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1214 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1215 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1216 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1217 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1218 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1219 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1220 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1221 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1222 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1223 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1224 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1225 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1226 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1227 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1228 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1229 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1230 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1231 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1232 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1233 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1234 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1235 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1236 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1237 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1238 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1239 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1240 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1241 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1242 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1243 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1244 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1245 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1246 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1247 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1248 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1249 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1250 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1251 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1252 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1253 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1254 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1255 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1256 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1257 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1258 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1259 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1260 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1261 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1262 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1263 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1264 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1265 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1266 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1267 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1268 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1269 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1270 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1271 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1272 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1273 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1274 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1275 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1276 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1277 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1278 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1279 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1280 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1281 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1282 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1283 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1284 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1285 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1286 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1287 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1288 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1289 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1290 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1291 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1292 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1293 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1294 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1295 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1296 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1297 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1298 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1299 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1300 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1301 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1302 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1303 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1304 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1305 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1306 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1307 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1308 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1309 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1310 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1311 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1312 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1313 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1314 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1315 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1316 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1317 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1318 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1319 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1320 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1321 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1322 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1323 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1324 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1325 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1326 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1327 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1328 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1329 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1330 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1331 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1332 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1333 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1334 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1335 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1336 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1337 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1338 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1339 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1340 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1341 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1342 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1343 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1344 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1345 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1346 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1347 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1348 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1349 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1350 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1351 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1352 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1353 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1354 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1355 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1356 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1357 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1358 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1359 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1360 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1361 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1362 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1363 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1364 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1365 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1366 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1367 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1368 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1369 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1370 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1371 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1372 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1373 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1374 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1375 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1376 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1377 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1378 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1379 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1380 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1381 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1382 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1383 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1384 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1385 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1386 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1387 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1388 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1389 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1390 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1391 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1392 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1393 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1394 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1395 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1396 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1397 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1398 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1399 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1400 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1401 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1402 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1403 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1404 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1405 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1406 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1407 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1408 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1409 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1410 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1411 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1412 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1413 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1414 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1415 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1416 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1417 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1418 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1419 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1420 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1421 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1422 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1423 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1424 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1425 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1426 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1427 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1428 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1429 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1430 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1431 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1432 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1433 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1434 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1435 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1436 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1437 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1438 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1439 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1440 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1441 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1442 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1443 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1444 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1445 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1446 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1447 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1448 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1449 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1450 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1451 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1452 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1453 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1454 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1455 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1456 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1457 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1458 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1459 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1460 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1461 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1462 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1463 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1464 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1465 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1466 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1467 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1468 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1469 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1470 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1471 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1472 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1473 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1474 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1475 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1476 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1477 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1478 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1479 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1480 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1481 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1482 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1483 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1484 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1485 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1486 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1487 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1488 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1489 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1490 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1491 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1492 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1493 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1494 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1495 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1496 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1497 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1498 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1499 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1500 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1501 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1502 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1503 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1504 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1505 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1506 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1507 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1508 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1509 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1510 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1511 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1512 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1513 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1514 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1515 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1516 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1517 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1518 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1519 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1520 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1521 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1522 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1523 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1524 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1525 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1526 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1527 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1528 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1529 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1530 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1531 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1532 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1533 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1534 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1535 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1536 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1537 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1538 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1539 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1540 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1541 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1542 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1543 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1544 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1545 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1546 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1547 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1548 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1549 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1550 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1551 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1552 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1553 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1554 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1555 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1556 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1557 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1558 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1559 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1560 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1561 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1562 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1563 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1564 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1565 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1566 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1567 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1568 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1569 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1570 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1571 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1572 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1573 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1574 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1575 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1576 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1577 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1578 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1579 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1580 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1581 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1582 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1583 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1584 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1585 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1586 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1587 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1588 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1589 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1590 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1591 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1592 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1593 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1594 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1595 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1596 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1597 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1598 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1599 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1600 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1601 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1602 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1603 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1604 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1605 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1606 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1607 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1608 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1609 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1610 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1611 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1612 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1613 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1614 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1615 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1616 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1617 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1618 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1619 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1620 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1621 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1622 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1623 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1624 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1625 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1626 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1627 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1628 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1629 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1630 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1631 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1632 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1633 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1634 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1635 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1636 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1637 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1638 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1639 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1640 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1641 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1642 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1643 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1644 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1645 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1646 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1647 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1648 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1649 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1650 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1651 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1652 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1653 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1654 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1655 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1656 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1657 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1658 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1659 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1660 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1661 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1662 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1663 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1664 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1665 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1666 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1667 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1668 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1669 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1670 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1671 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1672 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1673 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1674 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1675 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1676 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1677 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1678 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1679 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1680 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1681 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1682 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1683 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1684 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1685 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1686 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1687 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1688 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1689 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1690 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1691 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1692 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1693 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1694 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1695 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1696 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1697 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1698 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1699 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1700 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1701 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1702 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1703 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1704 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1705 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1706 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1707 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1708 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1709 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1710 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1711 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1712 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1713 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1714 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1715 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1716 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1717 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1718 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1719 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1720 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1721 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1722 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1723 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1724 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1725 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1726 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1727 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1728 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1729 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1730 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1731 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1732 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1733 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1734 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1735 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1736 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1737 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1738 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1739 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1740 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1741 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1742 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1743 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1744 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1745 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1746 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1747 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1748 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1749 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1750 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1751 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1752 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1753 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1754 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1755 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1756 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1757 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1758 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1759 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1760 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1761 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1762 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1763 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1764 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1765 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1766 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1767 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1768 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1769 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1770 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1771 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1772 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1773 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1774 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1775 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1776 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1777 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1778 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1779 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1780 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1781 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1782 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1783 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1784 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1785 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1786 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1787 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1788 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1789 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1790 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1791 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1792 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1793 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1794 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1795 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1796 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1797 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1798 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1799 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1800 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1801 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1802 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1803 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1804 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1805 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1806 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1807 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1808 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1809 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1810 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1811 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1812 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1813 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1814 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1815 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1816 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1817 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1818 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1819 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1820 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1821 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1822 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1823 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1824 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1825 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1826 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1827 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1828 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1829 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1830 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1831 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1832 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1833 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1834 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1835 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1836 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1837 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1838 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1839 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1840 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1841 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1842 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1843 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1844 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1845 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1846 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1847 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1848 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1849 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1850 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1851 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1852 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1853 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1854 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1855 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1856 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1857 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1858 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1859 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1860 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1861 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1862 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1863 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1864 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1865 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1866 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1867 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1868 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1869 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1870 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1871 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1872 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1873 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1874 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1875 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1876 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1877 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1878 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1879 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1880 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1881 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1882 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1883 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1884 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1885 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1886 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1887 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1888 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1889 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1890 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1891 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1892 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1893 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1894 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1895 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1896 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1897 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1898 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1899 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1900 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1901 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1902 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1903 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1904 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1905 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1906 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1907 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1908 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1909 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1910 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1911 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1912 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1913 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1914 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1915 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1916 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1917 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1918 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1919 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1920 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1921 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1922 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1923 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1924 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1925 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1926 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1927 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1928 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1929 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1930 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1931 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1932 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1933 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1934 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1935 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1936 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1937 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1938 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1939 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1940 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1941 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1942 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1943 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1944 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1945 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1946 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1947 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1948 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1949 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1950 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1951 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1952 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1953 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1954 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1955 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1956 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1957 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1958 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1959 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1960 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1961 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1962 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1963 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1964 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1965 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1966 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1967 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1968 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1969 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1970 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1971 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1972 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1973 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1974 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1975 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1976 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1977 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1978 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1979 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1980 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1981 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1982 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1983 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1984 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1985 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1986 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1987 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1988 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1989 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1990 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1991 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1992 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1993 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1994 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1995 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1996 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1997 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1998 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1999 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 2000 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 2001 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 2002 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2003 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2004 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2005 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2006 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2007 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2008 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2009 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2010 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2011 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2012 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2013 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2014 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2015 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2016 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2017 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2018 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2019 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2020 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2021 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2022 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2023 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2024 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2025 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2026 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2027 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2028 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2029 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2030 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2031 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2032 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2033 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2034 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2035 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2036 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2037 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2038 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2039 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2040 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2041 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2042 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2043 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2044 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2045 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2046 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2047 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2048 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2049 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2050 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2051 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2052 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2053 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2054 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2055 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2056 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2057 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2058 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2059 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2060 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2061 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2062 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2063 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2064 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2065 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2066 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2067 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2068 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2069 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2070 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2071 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2072 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2073 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2074 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2075 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2076 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2077 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2078 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2079 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2080 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2081 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2082 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2083 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2084 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2085 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2086 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2087 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2088 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2089 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2090 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2091 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2092 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2093 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2094 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2095 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2096 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2097 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2098 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2099 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2100 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2101 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2102 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2103 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2104 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2105 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2106 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2107 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2108 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2109 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2110 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2111 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2112 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2113 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2114 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2115 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2116 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2117 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2118 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2119 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2120 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2121 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2122 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2123 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2124 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2125 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2126 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2127 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2128 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2129 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2130 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2131 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2132 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2133 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2134 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2135 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2136 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2137 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2138 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2139 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2140 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2141 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2142 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2143 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2144 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2145 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2146 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2147 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2148 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2149 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2150 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2151 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2152 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2153 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2154 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2155 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2156 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2157 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2158 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2159 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2160 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2161 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2162 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2163 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2164 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2165 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2166 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2167 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2168 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2169 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2170 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2171 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2172 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2173 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2174 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2175 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2176 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2177 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2178 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2179 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2180 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2181 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2182 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2183 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2184 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2185 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2186 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2187 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2188 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2189 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2190 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2191 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2192 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2193 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2194 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2195 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2196 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2197 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2198 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2199 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2200 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2201 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2202 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2203 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2204 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2205 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2206 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2207 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2208 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2209 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2210 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2211 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2212 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2213 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2214 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2215 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2216 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2217 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2218 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2219 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2220 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2221 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2222 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2223 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2224 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2225 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2226 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2227 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2228 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2229 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2230 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2231 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2232 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2233 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2234 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2235 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2236 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2237 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2238 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2239 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2240 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2241 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2242 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2243 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2244 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2245 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2246 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2247 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2248 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2249 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2250 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2251 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2252 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2253 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2254 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2255 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2256 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2257 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2258 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2259 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2260 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2261 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2262 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2263 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2264 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2265 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2266 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2267 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2268 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2269 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2270 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2271 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2272 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2273 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2274 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2275 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2276 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2277 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2278 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2279 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2280 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2281 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2282 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2283 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2284 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2285 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2286 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2287 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2288 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2289 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2290 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2291 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2292 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2293 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2294 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2295 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2296 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2297 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2298 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2299 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2300 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2301 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2302 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2303 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2304 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2305 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2306 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2307 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2308 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2309 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2310 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2311 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2312 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2313 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2314 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2315 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2316 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2317 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2318 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2319 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2320 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2321 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2322 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2323 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2324 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2325 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2326 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2327 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2328 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2329 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2330 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2331 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2332 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2333 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2334 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2335 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2336 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2337 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2338 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2339 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2340 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2341 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2342 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2343 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2344 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2345 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2346 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2347 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2348 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2349 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2350 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2351 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2352 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2353 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2354 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2355 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2356 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2357 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2358 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2359 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2360 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2361 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2362 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2363 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2364 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2365 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2366 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2367 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2368 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2369 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2370 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2371 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2372 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2373 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2374 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2375 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2376 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2377 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2378 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2379 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2380 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2381 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2382 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2383 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2384 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2385 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2386 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2387 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2388 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2389 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2390 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2391 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2392 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2393 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2394 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2395 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2396 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2397 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2398 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2399 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2400 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2401 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2402 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2403 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2404 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2405 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2406 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2407 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2408 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2409 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2410 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2411 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2412 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2413 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2414 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2415 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2416 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2417 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2418 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2419 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2420 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2421 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2422 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2423 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2424 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2425 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2426 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2427 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2428 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2429 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2430 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2431 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2432 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2433 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2434 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2435 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2436 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2437 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2438 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2439 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2440 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2441 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2442 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2443 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2444 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2445 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2446 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2447 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2448 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2449 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2450 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2451 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2452 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2453 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2454 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2455 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2456 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2457 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2458 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2459 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2460 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2461 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2462 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2463 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2464 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2465 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2466 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2467 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2468 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2469 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2470 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2471 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2472 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2473 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2474 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2475 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2476 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2477 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2478 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2479 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2480 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2481 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2482 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2483 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2484 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2485 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2486 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2487 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2488 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2489 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2490 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2491 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2492 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2493 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2494 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2495 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2496 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2497 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2498 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2499 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2500 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2501 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2502 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2503 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2504 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2505 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2506 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2507 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2508 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2509 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2510 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2511 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2512 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2513 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2514 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2515 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2516 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2517 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2518 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2519 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2520 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2521 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2522 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2523 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2524 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2525 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2526 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2527 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2528 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2529 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2530 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2531 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2532 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2533 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2534 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2535 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2536 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2537 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2538 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2539 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2540 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2541 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2542 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2543 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2544 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2545 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2546 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2547 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2548 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2549 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2550 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2551 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2552 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2553 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2554 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2555 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2556 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2557 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2558 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2559 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2560 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2561 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2562 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2563 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2564 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2565 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2566 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2567 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2568 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2569 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2570 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2571 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2572 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2573 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2574 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2575 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2576 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2577 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2578 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2579 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2580 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2581 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2582 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2583 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2584 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2585 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2586 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2587 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2588 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2589 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2590 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2591 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2592 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2593 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2594 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2595 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2596 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2597 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2598 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2599 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2600 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2601 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2602 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2603 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2604 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2605 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2606 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2607 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2608 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2609 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2610 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2611 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2612 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2613 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2614 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2615 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2616 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2617 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2618 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2619 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2620 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2621 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2622 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2623 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2624 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2625 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2626 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2627 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2628 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2629 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2630 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2631 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2632 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2633 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2634 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2635 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2636 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2637 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2638 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2639 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2640 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2641 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2642 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2643 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2644 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2645 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2646 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2647 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2648 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2649 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2650 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2651 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2652 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2653 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2654 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2655 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2656 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2657 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2658 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2659 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2660 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2661 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2662 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2663 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2664 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2665 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2666 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2667 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2668 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2669 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2670 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2671 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2672 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2673 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2674 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2675 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2676 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2677 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2678 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2679 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2680 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2681 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2682 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2683 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2684 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2685 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2686 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2687 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2688 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2689 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2690 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2691 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2692 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2693 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2694 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2695 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2696 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2697 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2698 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2699 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2700 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2701 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2702 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2703 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2704 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2705 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2706 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2707 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2708 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2709 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2710 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2711 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2712 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2713 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2714 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2715 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2716 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2717 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2718 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2719 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2720 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2721 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2722 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2723 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2724 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2725 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2726 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2727 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2728 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2729 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2730 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2731 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2732 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2733 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2734 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2735 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2736 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2737 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2738 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2739 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2740 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2741 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2742 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2743 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2744 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2745 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2746 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2747 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2748 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2749 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2750 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2751 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2752 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2753 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2754 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2755 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2756 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2757 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2758 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2759 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2760 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2761 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2762 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2763 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2764 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2765 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2766 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2767 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2768 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2769 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2770 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2771 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2772 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2773 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2774 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2775 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2776 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2777 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2778 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2779 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2780 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2781 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2782 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2783 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2784 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2785 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2786 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2787 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2788 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2789 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2790 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2791 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2792 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2793 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2794 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2795 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2796 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2797 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2798 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2799 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2800 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2801 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2802 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2803 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2804 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2805 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2806 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2807 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2808 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2809 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2810 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2811 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2812 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2813 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2814 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2815 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2816 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2817 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2818 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2819 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2820 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2821 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2822 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2823 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2824 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2825 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2826 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2827 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2828 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2829 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2830 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2831 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2832 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2833 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2834 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2835 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2836 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2837 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2838 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2839 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2840 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2841 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2842 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2843 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2844 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2845 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2846 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2847 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2848 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2849 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2850 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2851 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2852 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2853 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2854 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2855 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2856 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2857 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2858 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2859 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2860 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2861 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2862 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2863 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2864 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2865 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2866 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2867 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2868 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2869 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2870 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2871 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2872 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2873 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2874 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2875 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2876 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2877 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2878 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2879 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2880 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2881 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2882 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2883 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2884 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2885 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2886 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2887 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2888 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2889 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2890 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2891 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2892 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2893 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2894 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2895 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2896 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2897 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2898 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2899 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2900 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2901 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2902 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2903 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2904 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2905 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2906 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2907 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2908 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2909 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2910 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2911 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2912 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2913 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2914 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2915 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2916 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2917 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2918 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2919 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2920 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2921 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2922 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2923 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2924 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2925 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2926 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2927 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2928 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2929 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2930 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2931 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2932 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2933 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2934 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2935 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2936 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2937 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2938 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2939 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2940 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2941 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2942 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2943 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2944 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2945 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2946 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2947 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2948 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2949 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2950 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2951 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2952 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2953 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2954 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2955 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2956 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2957 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2958 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2959 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2960 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2961 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2962 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2963 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2964 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2965 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2966 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2967 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2968 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2969 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2970 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2971 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2972 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2973 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2974 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2975 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2976 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2977 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2978 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2979 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2980 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2981 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2982 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2983 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2984 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2985 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2986 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2987 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2988 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2989 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2990 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2991 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2992 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2993 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2994 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2995 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2996 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2997 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2998 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2999 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 3000 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 3001 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 3002 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3003 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3004 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3005 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3006 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3007 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3008 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3009 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3010 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3011 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3012 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3013 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3014 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3015 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3016 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3017 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3018 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3019 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3020 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3021 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3022 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3023 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3024 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3025 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3026 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3027 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3028 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3029 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3030 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3031 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3032 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3033 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3034 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3035 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3036 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3037 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3038 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3039 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3040 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3041 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3042 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3043 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3044 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3045 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3046 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3047 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3048 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3049 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3050 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3051 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3052 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3053 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3054 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3055 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3056 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3057 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3058 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3059 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3060 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3061 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3062 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3063 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3064 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3065 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3066 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3067 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3068 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3069 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3070 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3071 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3072 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3073 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3074 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3075 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3076 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3077 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3078 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3079 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3080 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3081 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3082 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3083 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3084 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3085 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3086 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3087 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3088 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3089 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3090 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3091 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3092 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3093 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3094 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3095 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3096 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3097 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3098 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3099 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3100 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3101 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3102 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3103 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3104 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3105 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3106 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3107 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3108 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3109 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3110 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3111 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3112 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3113 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3114 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3115 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3116 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3117 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3118 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3119 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3120 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3121 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3122 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3123 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3124 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3125 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3126 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3127 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3128 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3129 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3130 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3131 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3132 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3133 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3134 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3135 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3136 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3137 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3138 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3139 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3140 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3141 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3142 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3143 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3144 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3145 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3146 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3147 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3148 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3149 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3150 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3151 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3152 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3153 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3154 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3155 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3156 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3157 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3158 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3159 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3160 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3161 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3162 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3163 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3164 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3165 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3166 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3167 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3168 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3169 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3170 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3171 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3172 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3173 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3174 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3175 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3176 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3177 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3178 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3179 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3180 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3181 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3182 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3183 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3184 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3185 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3186 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3187 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3188 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3189 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3190 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3191 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3192 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3193 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3194 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3195 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3196 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3197 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3198 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3199 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3200 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3201 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3202 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3203 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3204 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3205 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3206 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3207 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3208 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3209 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3210 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3211 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3212 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3213 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3214 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3215 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3216 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3217 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3218 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3219 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3220 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3221 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3222 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3223 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3224 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3225 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3226 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3227 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3228 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3229 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3230 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3231 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3232 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3233 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3234 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3235 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3236 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3237 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3238 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3239 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3240 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3241 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3242 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3243 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3244 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3245 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3246 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3247 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3248 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3249 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3250 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3251 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3252 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3253 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3254 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3255 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3256 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3257 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3258 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3259 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3260 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3261 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3262 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3263 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3264 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3265 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3266 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3267 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3268 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3269 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3270 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3271 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3272 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3273 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3274 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3275 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3276 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3277 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3278 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3279 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3280 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3281 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3282 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3283 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3284 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3285 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3286 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3287 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3288 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3289 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3290 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3291 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3292 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3293 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3294 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3295 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3296 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3297 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3298 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3299 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3300 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3301 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3302 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3303 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3304 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3305 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3306 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3307 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3308 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3309 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3310 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3311 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3312 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3313 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3314 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3315 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3316 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3317 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3318 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3319 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3320 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3321 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3322 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3323 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3324 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3325 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3326 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3327 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3328 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3329 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3330 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3331 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3332 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3333 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3334 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3335 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3336 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3337 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3338 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3339 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3340 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3341 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3342 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3343 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3344 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3345 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3346 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3347 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3348 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3349 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3350 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3351 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3352 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3353 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3354 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3355 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3356 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3357 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3358 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3359 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3360 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3361 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3362 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3363 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3364 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3365 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3366 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3367 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3368 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3369 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3370 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3371 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3372 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3373 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3374 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3375 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3376 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3377 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3378 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3379 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3380 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3381 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3382 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3383 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3384 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3385 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3386 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3387 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3388 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3389 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3390 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3391 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3392 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3393 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3394 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3395 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3396 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3397 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3398 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3399 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3400 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3401 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3402 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3403 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3404 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3405 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3406 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3407 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3408 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3409 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3410 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3411 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3412 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3413 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3414 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3415 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3416 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3417 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3418 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3419 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3420 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3421 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3422 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3423 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3424 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3425 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3426 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3427 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3428 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3429 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3430 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3431 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3432 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3433 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3434 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3435 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3436 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3437 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3438 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3439 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3440 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3441 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3442 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3443 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3444 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3445 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3446 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3447 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3448 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3449 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3450 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3451 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3452 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3453 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3454 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3455 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3456 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3457 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3458 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3459 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3460 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3461 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3462 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3463 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3464 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3465 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3466 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3467 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3468 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3469 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3470 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3471 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3472 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3473 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3474 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3475 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3476 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3477 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3478 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3479 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3480 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3481 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3482 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3483 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3484 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3485 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3486 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3487 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3488 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3489 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3490 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3491 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3492 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3493 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3494 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3495 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3496 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3497 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3498 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3499 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3500 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3501 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3502 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3503 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3504 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3505 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3506 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3507 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3508 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3509 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3510 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3511 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3512 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3513 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3514 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3515 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3516 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3517 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3518 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3519 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3520 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3521 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3522 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3523 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3524 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3525 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3526 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3527 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3528 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3529 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3530 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3531 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3532 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3533 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3534 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3535 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3536 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3537 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3538 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3539 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3540 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3541 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3542 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3543 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3544 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3545 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3546 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3547 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3548 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3549 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3550 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3551 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3552 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3553 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3554 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3555 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3556 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3557 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3558 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3559 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3560 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3561 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3562 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3563 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3564 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3565 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3566 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3567 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3568 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3569 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3570 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3571 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3572 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3573 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3574 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3575 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3576 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3577 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3578 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3579 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3580 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3581 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3582 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3583 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3584 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3585 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3586 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3587 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3588 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3589 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3590 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3591 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3592 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3593 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3594 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3595 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3596 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3597 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3598 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3599 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3600 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3601 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3602 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3603 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3604 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3605 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3606 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3607 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3608 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3609 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3610 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3611 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3612 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3613 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3614 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3615 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3616 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3617 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3618 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3619 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3620 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3621 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3622 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3623 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3624 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3625 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3626 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3627 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3628 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3629 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3630 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3631 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3632 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3633 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3634 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3635 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3636 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3637 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3638 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3639 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3640 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3641 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3642 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3643 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3644 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3645 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3646 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3647 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3648 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3649 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3650 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3651 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3652 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3653 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3654 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3655 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3656 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3657 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3658 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3659 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3660 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3661 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3662 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3663 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3664 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3665 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3666 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3667 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3668 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3669 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3670 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3671 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3672 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3673 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3674 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3675 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3676 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3677 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3678 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3679 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3680 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3681 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3682 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3683 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3684 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3685 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3686 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3687 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3688 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3689 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3690 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3691 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3692 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3693 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3694 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3695 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3696 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3697 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3698 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3699 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3700 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3701 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3702 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3703 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3704 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3705 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3706 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3707 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3708 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3709 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3710 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3711 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3712 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3713 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3714 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3715 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3716 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3717 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3718 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3719 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3720 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3721 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3722 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3723 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3724 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3725 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3726 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3727 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3728 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3729 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3730 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3731 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3732 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3733 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3734 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3735 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3736 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3737 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3738 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3739 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3740 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3741 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3742 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3743 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3744 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3745 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3746 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3747 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3748 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3749 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3750 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3751 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3752 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3753 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3754 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3755 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3756 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3757 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3758 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3759 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3760 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3761 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3762 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3763 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3764 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3765 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3766 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3767 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3768 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3769 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3770 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3771 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3772 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3773 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3774 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3775 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3776 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3777 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3778 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3779 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3780 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3781 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3782 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3783 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3784 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3785 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3786 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3787 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3788 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3789 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3790 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3791 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3792 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3793 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3794 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3795 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3796 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3797 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3798 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3799 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3800 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3801 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3802 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3803 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3804 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3805 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3806 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3807 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3808 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3809 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3810 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3811 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3812 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3813 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3814 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3815 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3816 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3817 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3818 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3819 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3820 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3821 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3822 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3823 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3824 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3825 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3826 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3827 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3828 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3829 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3830 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3831 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3832 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3833 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3834 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3835 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3836 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3837 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3838 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3839 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3840 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3841 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3842 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3843 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3844 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3845 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3846 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3847 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3848 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3849 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3850 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3851 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3852 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3853 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3854 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3855 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3856 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3857 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3858 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3859 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3860 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3861 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3862 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3863 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3864 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3865 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3866 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3867 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3868 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3869 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3870 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3871 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3872 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3873 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3874 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3875 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3876 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3877 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3878 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3879 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3880 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3881 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3882 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3883 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3884 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3885 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3886 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3887 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3888 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3889 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3890 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3891 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3892 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3893 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3894 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3895 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3896 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3897 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3898 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3899 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3900 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3901 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3902 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3903 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3904 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3905 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3906 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3907 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3908 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3909 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3910 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3911 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3912 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3913 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3914 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3915 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3916 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3917 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3918 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3919 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3920 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3921 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3922 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3923 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3924 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3925 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3926 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3927 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3928 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3929 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3930 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3931 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3932 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3933 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3934 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3935 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3936 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3937 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3938 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3939 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3940 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3941 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3942 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3943 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3944 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3945 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3946 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3947 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3948 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3949 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3950 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3951 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3952 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3953 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3954 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3955 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3956 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3957 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3958 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3959 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3960 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3961 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3962 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3963 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3964 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3965 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3966 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3967 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3968 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3969 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3970 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3971 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3972 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3973 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3974 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3975 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3976 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3977 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3978 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3979 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3980 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3981 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3982 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3983 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3984 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3985 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3986 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3987 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3988 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3989 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3990 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3991 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3992 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3993 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3994 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3995 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3996 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3997 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3998 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3999 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 4000 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 4001 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 4002 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4003 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4004 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4005 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4006 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4007 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4008 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4009 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4010 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4011 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4012 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4013 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4014 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4015 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4016 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4017 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4018 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4019 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4020 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4021 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4022 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4023 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4024 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4025 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4026 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4027 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4028 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4029 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4030 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4031 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4032 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4033 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4034 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4035 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4036 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4037 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4038 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4039 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4040 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4041 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4042 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4043 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4044 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4045 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4046 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4047 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4048 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4049 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4050 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4051 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4052 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4053 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4054 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4055 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4056 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4057 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4058 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4059 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4060 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4061 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4062 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4063 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4064 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4065 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4066 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4067 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4068 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4069 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4070 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4071 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4072 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4073 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4074 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4075 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4076 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4077 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4078 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4079 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4080 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4081 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4082 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4083 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4084 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4085 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4086 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4087 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4088 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4089 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4090 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4091 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4092 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4093 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4094 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4095 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4096 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4097 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4098 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4099 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4100 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4101 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4102 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4103 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4104 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4105 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4106 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4107 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4108 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4109 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4110 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4111 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4112 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4113 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4114 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4115 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4116 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4117 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4118 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4119 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4120 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4121 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4122 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4123 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4124 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4125 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4126 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4127 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4128 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4129 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4130 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4131 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4132 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4133 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4134 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4135 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4136 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4137 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4138 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4139 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4140 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4141 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4142 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4143 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4144 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4145 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4146 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4147 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4148 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4149 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4150 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4151 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4152 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4153 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4154 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4155 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4156 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4157 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4158 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4159 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4160 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4161 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4162 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4163 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4164 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4165 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4166 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4167 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4168 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4169 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4170 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4171 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4172 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4173 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4174 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4175 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4176 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4177 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4178 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4179 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4180 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4181 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4182 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4183 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4184 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4185 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4186 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4187 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4188 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4189 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4190 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4191 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4192 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4193 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4194 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4195 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4196 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4197 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4198 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4199 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4200 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4201 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4202 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4203 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4204 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4205 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4206 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4207 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4208 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4209 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4210 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4211 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4212 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4213 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4214 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4215 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4216 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4217 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4218 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4219 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4220 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4221 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4222 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4223 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4224 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4225 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4226 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4227 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4228 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4229 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4230 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4231 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4232 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4233 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4234 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4235 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4236 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4237 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4238 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4239 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4240 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4241 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4242 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4243 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4244 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4245 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4246 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4247 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4248 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4249 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4250 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4251 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4252 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4253 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4254 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4255 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4256 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4257 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4258 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4259 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4260 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4261 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4262 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4263 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4264 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4265 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4266 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4267 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4268 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4269 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4270 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4271 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4272 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4273 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4274 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4275 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4276 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4277 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4278 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4279 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4280 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4281 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4282 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4283 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4284 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4285 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4286 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4287 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4288 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4289 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4290 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4291 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4292 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4293 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4294 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4295 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4296 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4297 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4298 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4299 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4300 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4301 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4302 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4303 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4304 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4305 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4306 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4307 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4308 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4309 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4310 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4311 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4312 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4313 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4314 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4315 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4316 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4317 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4318 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4319 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4320 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4321 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4322 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4323 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4324 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4325 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4326 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4327 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4328 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4329 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4330 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4331 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4332 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4333 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4334 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4335 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4336 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4337 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4338 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4339 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4340 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4341 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4342 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4343 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4344 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4345 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4346 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4347 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4348 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4349 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4350 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4351 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4352 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4353 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4354 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4355 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4356 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4357 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4358 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4359 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4360 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4361 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4362 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4363 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4364 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4365 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4366 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4367 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4368 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4369 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4370 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4371 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4372 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4373 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4374 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4375 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4376 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4377 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4378 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4379 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4380 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4381 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4382 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4383 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4384 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4385 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4386 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4387 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4388 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4389 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4390 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4391 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4392 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4393 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4394 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4395 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4396 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4397 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4398 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4399 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4400 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4401 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4402 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4403 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4404 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4405 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4406 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4407 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4408 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4409 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4410 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4411 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4412 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4413 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4414 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4415 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4416 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4417 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4418 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4419 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4420 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4421 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4422 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4423 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4424 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4425 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4426 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4427 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4428 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4429 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4430 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4431 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4432 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4433 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4434 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4435 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4436 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4437 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4438 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4439 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4440 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4441 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4442 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4443 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4444 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4445 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4446 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4447 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4448 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4449 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4450 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4451 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4452 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4453 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4454 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4455 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4456 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4457 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4458 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4459 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4460 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4461 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4462 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4463 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4464 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4465 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4466 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4467 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4468 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4469 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4470 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4471 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4472 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4473 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4474 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4475 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4476 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4477 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4478 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4479 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4480 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4481 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4482 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4483 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4484 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4485 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4486 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4487 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4488 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4489 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4490 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4491 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4492 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4493 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4494 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4495 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4496 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4497 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4498 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4499 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4500 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4501 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4502 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4503 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4504 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4505 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4506 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4507 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4508 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4509 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4510 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4511 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4512 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4513 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4514 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4515 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4516 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4517 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4518 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4519 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4520 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4521 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4522 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4523 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4524 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4525 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4526 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4527 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4528 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4529 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4530 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4531 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4532 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4533 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4534 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4535 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4536 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4537 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4538 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4539 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4540 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4541 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4542 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4543 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4544 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4545 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4546 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4547 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4548 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4549 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4550 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4551 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4552 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4553 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4554 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4555 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4556 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4557 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4558 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4559 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4560 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4561 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4562 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4563 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4564 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4565 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4566 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4567 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4568 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4569 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4570 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4571 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4572 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4573 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4574 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4575 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4576 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4577 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4578 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4579 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4580 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4581 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4582 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4583 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4584 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4585 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4586 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4587 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4588 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4589 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4590 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4591 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4592 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4593 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4594 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4595 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4596 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4597 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4598 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4599 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4600 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4601 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4602 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4603 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4604 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4605 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4606 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4607 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4608 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4609 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4610 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4611 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4612 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4613 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4614 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4615 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4616 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4617 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4618 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4619 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4620 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4621 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4622 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4623 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4624 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4625 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4626 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4627 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4628 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4629 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4630 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4631 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4632 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4633 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4634 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4635 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4636 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4637 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4638 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4639 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4640 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4641 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4642 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4643 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4644 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4645 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4646 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4647 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4648 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4649 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4650 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4651 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4652 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4653 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4654 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4655 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4656 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4657 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4658 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4659 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4660 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4661 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4662 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4663 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4664 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4665 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4666 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4667 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4668 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4669 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4670 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4671 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4672 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4673 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4674 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4675 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4676 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4677 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4678 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4679 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4680 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4681 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4682 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4683 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4684 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4685 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4686 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4687 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4688 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4689 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4690 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4691 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4692 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4693 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4694 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4695 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4696 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4697 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4698 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4699 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4700 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4701 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4702 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4703 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4704 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4705 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4706 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4707 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4708 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4709 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4710 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4711 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4712 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4713 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4714 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4715 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4716 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4717 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4718 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4719 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4720 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4721 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4722 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4723 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4724 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4725 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4726 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4727 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4728 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4729 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4730 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4731 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4732 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4733 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4734 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4735 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4736 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4737 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4738 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4739 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4740 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4741 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4742 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4743 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4744 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4745 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4746 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4747 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4748 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4749 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4750 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4751 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4752 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4753 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4754 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4755 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4756 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4757 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4758 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4759 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4760 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4761 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4762 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4763 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4764 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4765 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4766 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4767 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4768 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4769 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4770 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4771 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4772 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4773 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4774 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4775 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4776 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4777 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4778 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4779 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4780 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4781 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4782 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4783 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4784 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4785 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4786 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4787 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4788 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4789 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4790 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4791 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4792 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4793 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4794 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4795 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4796 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4797 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4798 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4799 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4800 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4801 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4802 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4803 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4804 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4805 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4806 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4807 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4808 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4809 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4810 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4811 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4812 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4813 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4814 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4815 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4816 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4817 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4818 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4819 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4820 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4821 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4822 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4823 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4824 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4825 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4826 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4827 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4828 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4829 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4830 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4831 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4832 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4833 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4834 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4835 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4836 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4837 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4838 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4839 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4840 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4841 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4842 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4843 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4844 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4845 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4846 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4847 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4848 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4849 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4850 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4851 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4852 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4853 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4854 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4855 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4856 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4857 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4858 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4859 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4860 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4861 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4862 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4863 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4864 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4865 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4866 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4867 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4868 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4869 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4870 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4871 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4872 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4873 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4874 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4875 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4876 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4877 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4878 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4879 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4880 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4881 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4882 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4883 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4884 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4885 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4886 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4887 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4888 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4889 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4890 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4891 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4892 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4893 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4894 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4895 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4896 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4897 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4898 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4899 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4900 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4901 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4902 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4903 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4904 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4905 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4906 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4907 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4908 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4909 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4910 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4911 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4912 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4913 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4914 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4915 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4916 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4917 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4918 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4919 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4920 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4921 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4922 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4923 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4924 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4925 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4926 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4927 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4928 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4929 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4930 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4931 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4932 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4933 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4934 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4935 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4936 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4937 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4938 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4939 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4940 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4941 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4942 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4943 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4944 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4945 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4946 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4947 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4948 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4949 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4950 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4951 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4952 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4953 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4954 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4955 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4956 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4957 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4958 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4959 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4960 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4961 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4962 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4963 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4964 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4965 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4966 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4967 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4968 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4969 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4970 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4971 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4972 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4973 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4974 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4975 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4976 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4977 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4978 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4979 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4980 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4981 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4982 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4983 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4984 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4985 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4986 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4987 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4988 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4989 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4990 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4991 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4992 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4993 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4994 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4995 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4996 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4997 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4998 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4999 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 5000 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 5001 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 5002 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5003 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5004 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5005 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5006 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5007 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5008 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5009 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5010 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5011 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5012 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5013 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5014 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5015 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5016 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5017 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5018 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5019 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5020 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5021 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5022 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5023 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5024 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5025 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5026 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5027 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5028 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5029 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5030 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5031 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5032 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5033 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5034 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5035 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5036 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5037 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5038 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5039 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5040 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5041 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5042 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5043 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5044 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5045 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5046 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5047 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5048 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5049 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5050 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5051 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5052 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5053 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5054 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5055 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5056 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5057 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5058 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5059 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5060 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5061 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5062 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5063 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5064 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5065 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5066 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5067 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5068 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5069 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5070 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5071 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5072 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5073 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5074 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5075 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5076 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5077 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5078 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5079 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5080 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5081 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5082 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5083 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5084 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5085 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5086 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5087 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5088 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5089 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5090 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5091 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5092 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5093 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5094 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5095 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5096 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5097 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5098 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5099 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5100 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5101 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5102 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5103 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5104 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5105 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5106 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5107 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5108 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5109 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5110 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5111 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5112 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5113 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5114 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5115 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5116 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5117 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5118 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5119 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5120 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5121 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5122 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5123 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5124 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5125 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5126 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5127 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5128 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5129 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5130 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5131 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5132 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5133 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5134 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5135 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5136 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5137 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5138 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5139 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5140 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5141 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5142 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5143 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5144 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5145 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5146 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5147 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5148 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5149 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5150 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5151 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5152 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5153 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5154 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5155 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5156 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5157 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5158 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5159 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5160 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5161 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5162 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5163 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5164 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5165 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5166 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5167 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5168 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5169 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5170 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5171 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5172 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5173 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5174 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5175 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5176 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5177 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5178 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5179 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5180 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5181 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5182 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5183 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5184 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5185 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5186 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5187 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5188 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5189 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5190 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5191 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5192 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5193 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5194 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5195 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5196 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5197 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5198 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5199 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5200 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5201 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5202 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5203 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5204 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5205 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5206 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5207 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5208 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5209 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5210 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5211 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5212 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5213 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5214 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5215 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5216 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5217 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5218 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5219 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5220 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5221 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5222 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5223 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5224 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5225 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5226 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5227 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5228 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5229 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5230 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5231 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5232 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5233 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5234 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5235 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5236 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5237 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5238 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5239 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5240 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5241 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5242 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5243 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5244 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5245 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5246 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5247 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5248 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5249 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5250 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5251 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5252 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5253 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5254 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5255 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5256 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5257 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5258 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5259 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5260 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5261 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5262 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5263 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5264 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5265 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5266 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5267 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5268 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5269 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5270 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5271 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5272 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5273 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5274 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5275 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5276 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5277 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5278 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5279 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5280 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5281 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5282 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5283 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5284 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5285 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5286 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5287 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5288 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5289 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5290 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5291 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5292 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5293 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5294 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5295 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5296 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5297 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5298 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5299 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5300 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5301 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5302 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5303 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5304 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5305 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5306 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5307 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5308 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5309 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5310 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5311 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5312 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5313 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5314 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5315 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5316 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5317 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5318 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5319 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5320 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5321 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5322 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5323 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5324 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5325 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5326 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5327 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5328 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5329 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5330 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5331 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5332 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5333 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5334 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5335 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5336 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5337 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5338 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5339 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5340 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5341 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5342 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5343 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5344 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5345 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5346 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5347 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5348 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5349 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5350 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5351 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5352 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5353 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5354 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5355 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5356 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5357 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5358 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5359 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5360 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5361 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5362 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5363 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5364 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5365 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5366 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5367 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5368 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5369 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5370 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5371 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5372 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5373 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5374 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5375 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5376 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5377 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5378 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5379 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5380 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5381 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5382 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5383 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5384 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5385 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5386 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5387 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5388 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5389 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5390 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5391 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5392 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5393 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5394 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5395 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5396 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5397 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5398 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5399 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5400 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5401 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5402 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5403 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5404 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5405 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5406 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5407 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5408 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5409 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5410 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5411 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5412 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5413 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5414 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5415 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5416 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5417 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5418 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5419 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5420 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5421 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5422 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5423 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5424 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5425 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5426 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5427 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5428 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5429 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5430 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5431 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5432 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5433 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5434 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5435 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5436 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5437 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5438 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5439 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5440 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5441 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5442 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5443 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5444 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5445 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5446 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5447 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5448 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5449 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5450 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5451 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5452 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5453 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5454 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5455 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5456 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5457 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5458 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5459 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5460 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5461 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5462 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5463 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5464 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5465 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5466 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5467 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5468 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5469 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5470 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5471 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5472 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5473 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5474 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5475 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5476 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5477 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5478 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5479 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5480 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5481 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5482 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5483 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5484 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5485 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5486 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5487 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5488 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5489 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5490 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5491 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5492 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5493 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5494 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5495 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5496 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5497 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5498 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5499 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5500 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5501 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5502 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5503 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5504 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5505 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5506 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5507 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5508 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5509 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5510 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5511 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5512 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5513 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5514 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5515 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5516 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5517 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5518 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5519 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5520 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5521 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5522 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5523 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5524 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5525 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5526 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5527 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5528 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5529 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5530 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5531 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5532 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5533 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5534 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5535 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5536 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5537 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5538 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5539 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5540 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5541 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5542 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5543 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5544 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5545 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5546 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5547 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5548 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5549 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5550 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5551 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5552 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5553 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5554 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5555 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5556 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5557 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5558 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5559 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5560 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5561 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5562 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5563 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5564 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5565 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5566 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5567 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5568 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5569 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5570 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5571 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5572 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5573 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5574 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5575 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5576 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5577 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5578 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5579 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5580 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5581 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5582 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5583 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5584 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5585 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5586 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5587 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5588 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5589 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5590 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5591 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5592 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5593 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5594 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5595 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5596 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5597 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5598 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5599 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5600 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5601 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5602 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5603 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5604 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5605 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5606 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5607 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5608 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5609 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5610 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5611 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5612 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5613 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5614 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5615 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5616 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5617 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5618 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5619 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5620 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5621 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5622 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5623 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5624 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5625 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5626 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5627 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5628 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5629 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5630 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5631 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5632 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5633 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5634 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5635 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5636 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5637 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5638 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5639 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5640 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5641 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5642 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5643 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5644 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5645 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5646 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5647 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5648 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5649 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5650 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5651 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5652 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5653 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5654 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5655 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5656 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5657 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5658 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5659 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5660 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5661 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5662 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5663 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5664 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5665 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5666 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5667 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5668 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5669 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5670 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5671 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5672 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5673 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5674 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5675 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5676 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5677 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5678 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5679 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5680 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5681 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5682 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5683 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5684 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5685 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5686 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5687 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5688 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5689 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5690 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5691 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5692 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5693 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5694 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5695 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5696 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5697 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5698 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5699 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5700 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5701 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5702 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5703 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5704 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5705 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5706 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5707 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5708 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5709 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5710 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5711 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5712 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5713 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5714 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5715 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5716 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5717 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5718 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5719 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5720 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5721 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5722 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5723 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5724 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5725 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5726 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5727 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5728 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5729 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5730 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5731 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5732 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5733 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5734 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5735 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5736 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5737 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5738 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5739 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5740 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5741 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5742 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5743 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5744 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5745 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5746 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5747 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5748 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5749 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5750 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5751 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5752 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5753 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5754 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5755 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5756 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5757 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5758 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5759 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5760 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5761 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5762 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5763 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5764 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5765 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5766 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5767 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5768 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5769 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5770 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5771 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5772 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5773 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5774 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5775 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5776 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5777 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5778 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5779 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5780 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5781 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5782 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5783 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5784 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5785 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5786 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5787 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5788 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5789 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5790 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5791 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5792 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5793 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5794 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5795 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5796 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5797 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5798 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5799 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5800 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5801 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5802 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5803 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5804 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5805 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5806 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5807 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5808 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5809 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5810 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5811 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5812 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5813 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5814 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5815 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5816 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5817 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5818 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5819 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5820 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5821 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5822 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5823 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5824 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5825 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5826 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5827 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5828 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5829 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5830 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5831 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5832 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5833 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5834 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5835 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5836 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5837 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5838 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5839 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5840 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5841 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5842 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5843 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5844 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5845 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5846 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5847 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5848 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5849 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5850 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5851 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5852 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5853 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5854 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5855 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5856 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5857 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5858 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5859 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5860 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5861 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5862 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5863 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5864 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5865 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5866 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5867 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5868 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5869 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5870 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5871 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5872 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5873 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5874 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5875 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5876 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5877 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5878 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5879 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5880 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5881 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5882 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5883 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5884 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5885 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5886 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5887 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5888 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5889 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5890 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5891 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5892 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5893 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5894 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5895 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5896 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5897 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5898 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5899 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5900 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5901 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5902 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5903 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5904 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5905 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5906 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5907 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5908 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5909 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5910 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5911 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5912 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5913 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5914 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5915 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5916 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5917 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5918 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5919 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5920 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5921 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5922 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5923 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5924 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5925 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5926 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5927 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5928 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5929 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5930 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5931 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5932 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5933 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5934 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5935 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5936 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5937 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5938 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5939 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5940 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5941 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5942 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5943 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5944 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5945 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5946 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5947 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5948 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5949 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5950 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5951 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5952 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5953 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5954 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5955 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5956 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5957 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5958 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5959 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5960 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5961 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5962 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5963 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5964 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5965 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5966 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5967 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5968 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5969 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5970 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5971 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5972 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5973 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5974 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5975 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5976 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5977 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5978 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5979 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5980 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5981 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5982 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5983 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5984 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5985 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5986 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5987 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5988 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5989 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5990 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5991 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5992 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5993 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5994 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5995 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5996 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5997 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5998 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5999 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 6000 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 6001 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 6002 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6003 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6004 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6005 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6006 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6007 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6008 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6009 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6010 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6011 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6012 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6013 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6014 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6015 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6016 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6017 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6018 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6019 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6020 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6021 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6022 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6023 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6024 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6025 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6026 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6027 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6028 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6029 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6030 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6031 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6032 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6033 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6034 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6035 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6036 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6037 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6038 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6039 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6040 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6041 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6042 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6043 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6044 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6045 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6046 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6047 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6048 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6049 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6050 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6051 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6052 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6053 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6054 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6055 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6056 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6057 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6058 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6059 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6060 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6061 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6062 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6063 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6064 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6065 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6066 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6067 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6068 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6069 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6070 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6071 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6072 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6073 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6074 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6075 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6076 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6077 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6078 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6079 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6080 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6081 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6082 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6083 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6084 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6085 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6086 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6087 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6088 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6089 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6090 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6091 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6092 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6093 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6094 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6095 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6096 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6097 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6098 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6099 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6100 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6101 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6102 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6103 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6104 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6105 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6106 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6107 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6108 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6109 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6110 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6111 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6112 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6113 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6114 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6115 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6116 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6117 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6118 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6119 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6120 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6121 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6122 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6123 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6124 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6125 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6126 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6127 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6128 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6129 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6130 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6131 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6132 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6133 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6134 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6135 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6136 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6137 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6138 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6139 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6140 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6141 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6142 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6143 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6144 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6145 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6146 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6147 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6148 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6149 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6150 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6151 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6152 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6153 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6154 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6155 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6156 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6157 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6158 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6159 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6160 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6161 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6162 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6163 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6164 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6165 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6166 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6167 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6168 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6169 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6170 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6171 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6172 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6173 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6174 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6175 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6176 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6177 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6178 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6179 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6180 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6181 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6182 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6183 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6184 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6185 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6186 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6187 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6188 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6189 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6190 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6191 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6192 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6193 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6194 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6195 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6196 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6197 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6198 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6199 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6200 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6201 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6202 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6203 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6204 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6205 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6206 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6207 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6208 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6209 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6210 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6211 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6212 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6213 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6214 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6215 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6216 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6217 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6218 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6219 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6220 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6221 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6222 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6223 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6224 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6225 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6226 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6227 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6228 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6229 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6230 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6231 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6232 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6233 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6234 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6235 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6236 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6237 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6238 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6239 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6240 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6241 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6242 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6243 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6244 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6245 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6246 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6247 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6248 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6249 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6250 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6251 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6252 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6253 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6254 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6255 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6256 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6257 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6258 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6259 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6260 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6261 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6262 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6263 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6264 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6265 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6266 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6267 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6268 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6269 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6270 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6271 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6272 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6273 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6274 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6275 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6276 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6277 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6278 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6279 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6280 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6281 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6282 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6283 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6284 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6285 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6286 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6287 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6288 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6289 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6290 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6291 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6292 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6293 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6294 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6295 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6296 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6297 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6298 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6299 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6300 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6301 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6302 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6303 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6304 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6305 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6306 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6307 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6308 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6309 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6310 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6311 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6312 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6313 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6314 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6315 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6316 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6317 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6318 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6319 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6320 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6321 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6322 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6323 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6324 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6325 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6326 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6327 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6328 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6329 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6330 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6331 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6332 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6333 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6334 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6335 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6336 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6337 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6338 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6339 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6340 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6341 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6342 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6343 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6344 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6345 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6346 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6347 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6348 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6349 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6350 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6351 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6352 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6353 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6354 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6355 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6356 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6357 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6358 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6359 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6360 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6361 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6362 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6363 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6364 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6365 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6366 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6367 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6368 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6369 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6370 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6371 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6372 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6373 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6374 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6375 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6376 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6377 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6378 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6379 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6380 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6381 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6382 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6383 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6384 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6385 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6386 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6387 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6388 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6389 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6390 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6391 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6392 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6393 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6394 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6395 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6396 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6397 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6398 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6399 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6400 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6401 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6402 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6403 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6404 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6405 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6406 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6407 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6408 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6409 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6410 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6411 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6412 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6413 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6414 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6415 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6416 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6417 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6418 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6419 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6420 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6421 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6422 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6423 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6424 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6425 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6426 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6427 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6428 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6429 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6430 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6431 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6432 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6433 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6434 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6435 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6436 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6437 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6438 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6439 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6440 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6441 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6442 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6443 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6444 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6445 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6446 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6447 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6448 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6449 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6450 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6451 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6452 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6453 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6454 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6455 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6456 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6457 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6458 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6459 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6460 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6461 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6462 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6463 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6464 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6465 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6466 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6467 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6468 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6469 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6470 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6471 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6472 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6473 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6474 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6475 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6476 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6477 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6478 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6479 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6480 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6481 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6482 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6483 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6484 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6485 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6486 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6487 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6488 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6489 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6490 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6491 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6492 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6493 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6494 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6495 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6496 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6497 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6498 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6499 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6500 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6501 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6502 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6503 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6504 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6505 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6506 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6507 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6508 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6509 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6510 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6511 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6512 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6513 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6514 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6515 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6516 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6517 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6518 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6519 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6520 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6521 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6522 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6523 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6524 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6525 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6526 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6527 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6528 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6529 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6530 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6531 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6532 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6533 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6534 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6535 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6536 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6537 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6538 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6539 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6540 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6541 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6542 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6543 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6544 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6545 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6546 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6547 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6548 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6549 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6550 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6551 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6552 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6553 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6554 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6555 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6556 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6557 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6558 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6559 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6560 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6561 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
added
protocol/core_transfer_matrix_draft.csv
+403 −0
@@ -0,0 +1,403 @@ | ||
| 1 | +experiment_id,condition,method,access,sender,receiver,family,document_id,split,target_tokens,n_questions,seed,expected_trials | |
| 2 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03000_2000,test,2000,8,0,8 | |
| 3 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03000_2000,test,2000,8,0,8 | |
| 4 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03000_2000,test,2000,8,0,8 | |
| 5 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03000_2000,test,2000,8,0,8 | |
| 6 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03000_2000,test,2000,8,0,8 | |
| 7 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03000_2000,test,2000,8,0,8 | |
| 8 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03001_8000,test,8000,8,0,8 | |
| 9 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03001_8000,test,8000,8,0,8 | |
| 10 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03001_8000,test,8000,8,0,8 | |
| 11 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03001_8000,test,8000,8,0,8 | |
| 12 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03001_8000,test,8000,8,0,8 | |
| 13 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03001_8000,test,8000,8,0,8 | |
| 14 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03003_2000,test,2000,8,0,8 | |
| 15 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03003_2000,test,2000,8,0,8 | |
| 16 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03003_2000,test,2000,8,0,8 | |
| 17 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03003_2000,test,2000,8,0,8 | |
| 18 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03003_2000,test,2000,8,0,8 | |
| 19 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03003_2000,test,2000,8,0,8 | |
| 20 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03004_8000,test,8000,8,0,8 | |
| 21 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03004_8000,test,8000,8,0,8 | |
| 22 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03004_8000,test,8000,8,0,8 | |
| 23 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03004_8000,test,8000,8,0,8 | |
| 24 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03004_8000,test,8000,8,0,8 | |
| 25 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03004_8000,test,8000,8,0,8 | |
| 26 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03006_2000,test,2000,8,0,8 | |
| 27 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03006_2000,test,2000,8,0,8 | |
| 28 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03006_2000,test,2000,8,0,8 | |
| 29 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03006_2000,test,2000,8,0,8 | |
| 30 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03006_2000,test,2000,8,0,8 | |
| 31 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03006_2000,test,2000,8,0,8 | |
| 32 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03007_8000,test,8000,8,0,8 | |
| 33 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03007_8000,test,8000,8,0,8 | |
| 34 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03007_8000,test,8000,8,0,8 | |
| 35 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03007_8000,test,8000,8,0,8 | |
| 36 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03007_8000,test,8000,8,0,8 | |
| 37 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03007_8000,test,8000,8,0,8 | |
| 38 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03009_2000,test,2000,8,0,8 | |
| 39 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03009_2000,test,2000,8,0,8 | |
| 40 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03009_2000,test,2000,8,0,8 | |
| 41 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03009_2000,test,2000,8,0,8 | |
| 42 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03009_2000,test,2000,8,0,8 | |
| 43 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03009_2000,test,2000,8,0,8 | |
| 44 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03010_8000,test,8000,8,0,8 | |
| 45 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03010_8000,test,8000,8,0,8 | |
| 46 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03010_8000,test,8000,8,0,8 | |
| 47 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03010_8000,test,8000,8,0,8 | |
| 48 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03010_8000,test,8000,8,0,8 | |
| 49 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03010_8000,test,8000,8,0,8 | |
| 50 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03012_2000,test,2000,8,0,8 | |
| 51 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03012_2000,test,2000,8,0,8 | |
| 52 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03012_2000,test,2000,8,0,8 | |
| 53 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03012_2000,test,2000,8,0,8 | |
| 54 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03012_2000,test,2000,8,0,8 | |
| 55 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03012_2000,test,2000,8,0,8 | |
| 56 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03013_8000,test,8000,8,0,8 | |
| 57 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03013_8000,test,8000,8,0,8 | |
| 58 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03013_8000,test,8000,8,0,8 | |
| 59 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03013_8000,test,8000,8,0,8 | |
| 60 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03013_8000,test,8000,8,0,8 | |
| 61 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03013_8000,test,8000,8,0,8 | |
| 62 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03015_2000,test,2000,8,0,8 | |
| 63 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03015_2000,test,2000,8,0,8 | |
| 64 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03015_2000,test,2000,8,0,8 | |
| 65 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03015_2000,test,2000,8,0,8 | |
| 66 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03015_2000,test,2000,8,0,8 | |
| 67 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03015_2000,test,2000,8,0,8 | |
| 68 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03016_8000,test,8000,8,0,8 | |
| 69 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03016_8000,test,8000,8,0,8 | |
| 70 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03016_8000,test,8000,8,0,8 | |
| 71 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03016_8000,test,8000,8,0,8 | |
| 72 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03016_8000,test,8000,8,0,8 | |
| 73 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03016_8000,test,8000,8,0,8 | |
| 74 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03018_2000,test,2000,8,0,8 | |
| 75 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03018_2000,test,2000,8,0,8 | |
| 76 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03018_2000,test,2000,8,0,8 | |
| 77 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03018_2000,test,2000,8,0,8 | |
| 78 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03018_2000,test,2000,8,0,8 | |
| 79 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03018_2000,test,2000,8,0,8 | |
| 80 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03019_8000,test,8000,8,0,8 | |
| 81 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03019_8000,test,8000,8,0,8 | |
| 82 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03019_8000,test,8000,8,0,8 | |
| 83 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03019_8000,test,8000,8,0,8 | |
| 84 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03019_8000,test,8000,8,0,8 | |
| 85 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03019_8000,test,8000,8,0,8 | |
| 86 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03021_2000,test,2000,8,0,8 | |
| 87 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03021_2000,test,2000,8,0,8 | |
| 88 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03021_2000,test,2000,8,0,8 | |
| 89 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03021_2000,test,2000,8,0,8 | |
| 90 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03021_2000,test,2000,8,0,8 | |
| 91 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03021_2000,test,2000,8,0,8 | |
| 92 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03022_8000,test,8000,8,0,8 | |
| 93 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03022_8000,test,8000,8,0,8 | |
| 94 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03022_8000,test,8000,8,0,8 | |
| 95 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03022_8000,test,8000,8,0,8 | |
| 96 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03022_8000,test,8000,8,0,8 | |
| 97 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03022_8000,test,8000,8,0,8 | |
| 98 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03024_2000,test,2000,8,0,8 | |
| 99 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03024_2000,test,2000,8,0,8 | |
| 100 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03024_2000,test,2000,8,0,8 | |
| 101 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03024_2000,test,2000,8,0,8 | |
| 102 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03024_2000,test,2000,8,0,8 | |
| 103 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03024_2000,test,2000,8,0,8 | |
| 104 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03025_8000,test,8000,8,0,8 | |
| 105 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03025_8000,test,8000,8,0,8 | |
| 106 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03025_8000,test,8000,8,0,8 | |
| 107 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03025_8000,test,8000,8,0,8 | |
| 108 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03025_8000,test,8000,8,0,8 | |
| 109 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03025_8000,test,8000,8,0,8 | |
| 110 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03027_2000,test,2000,8,0,8 | |
| 111 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03027_2000,test,2000,8,0,8 | |
| 112 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03027_2000,test,2000,8,0,8 | |
| 113 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03027_2000,test,2000,8,0,8 | |
| 114 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03027_2000,test,2000,8,0,8 | |
| 115 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03027_2000,test,2000,8,0,8 | |
| 116 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03028_8000,test,8000,8,0,8 | |
| 117 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03028_8000,test,8000,8,0,8 | |
| 118 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03028_8000,test,8000,8,0,8 | |
| 119 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03028_8000,test,8000,8,0,8 | |
| 120 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03028_8000,test,8000,8,0,8 | |
| 121 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03028_8000,test,8000,8,0,8 | |
| 122 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03030_2000,test,2000,8,0,8 | |
| 123 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03030_2000,test,2000,8,0,8 | |
| 124 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03030_2000,test,2000,8,0,8 | |
| 125 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03030_2000,test,2000,8,0,8 | |
| 126 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03030_2000,test,2000,8,0,8 | |
| 127 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03030_2000,test,2000,8,0,8 | |
| 128 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03031_8000,test,8000,8,0,8 | |
| 129 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03031_8000,test,8000,8,0,8 | |
| 130 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03031_8000,test,8000,8,0,8 | |
| 131 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03031_8000,test,8000,8,0,8 | |
| 132 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03031_8000,test,8000,8,0,8 | |
| 133 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03031_8000,test,8000,8,0,8 | |
| 134 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03033_2000,test,2000,8,0,8 | |
| 135 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03033_2000,test,2000,8,0,8 | |
| 136 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03033_2000,test,2000,8,0,8 | |
| 137 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03033_2000,test,2000,8,0,8 | |
| 138 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03033_2000,test,2000,8,0,8 | |
| 139 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03033_2000,test,2000,8,0,8 | |
| 140 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03034_8000,test,8000,8,0,8 | |
| 141 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03034_8000,test,8000,8,0,8 | |
| 142 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03034_8000,test,8000,8,0,8 | |
| 143 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03034_8000,test,8000,8,0,8 | |
| 144 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03034_8000,test,8000,8,0,8 | |
| 145 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03034_8000,test,8000,8,0,8 | |
| 146 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03036_2000,test,2000,8,0,8 | |
| 147 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03036_2000,test,2000,8,0,8 | |
| 148 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03036_2000,test,2000,8,0,8 | |
| 149 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03036_2000,test,2000,8,0,8 | |
| 150 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03036_2000,test,2000,8,0,8 | |
| 151 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03036_2000,test,2000,8,0,8 | |
| 152 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03037_8000,test,8000,8,0,8 | |
| 153 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03037_8000,test,8000,8,0,8 | |
| 154 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03037_8000,test,8000,8,0,8 | |
| 155 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03037_8000,test,8000,8,0,8 | |
| 156 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03037_8000,test,8000,8,0,8 | |
| 157 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03037_8000,test,8000,8,0,8 | |
| 158 | +E3_core,A1,A1,none,qwen1b5,qwen3b,synthetic,syn_03039_2000,test,2000,8,0,8 | |
| 159 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,synthetic,syn_03039_2000,test,2000,8,0,8 | |
| 160 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,synthetic,syn_03039_2000,test,2000,8,0,8 | |
| 161 | +E3_core,C0,C0,none,qwen1b5,qwen3b,synthetic,syn_03039_2000,test,2000,8,0,8 | |
| 162 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,synthetic,syn_03039_2000,test,2000,8,0,8 | |
| 163 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,synthetic,syn_03039_2000,test,2000,8,0,8 | |
| 164 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 165 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 166 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 167 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 168 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 169 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 170 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 171 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 172 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 173 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 174 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 175 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 176 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 177 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 178 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 179 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 180 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 181 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 182 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 183 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 184 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 185 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 186 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 187 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 188 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 189 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 190 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 191 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 192 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 193 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 194 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 195 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 196 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 197 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 198 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 199 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 200 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 201 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 202 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 203 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 204 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 205 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 206 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 207 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 208 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 209 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 210 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 211 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 212 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 213 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 214 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 215 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 216 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 217 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 218 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 219 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 220 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 221 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 222 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 223 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 224 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 225 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 226 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 227 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 228 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 229 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 230 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 231 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 232 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 233 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 234 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 235 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 236 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 237 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 238 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 239 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 240 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 241 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 242 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 243 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 244 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 245 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 246 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 247 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 248 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 249 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 250 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 251 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 252 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 253 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 254 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 255 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 256 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 257 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 258 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 259 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 260 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 261 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 262 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 263 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 264 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 265 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 266 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 267 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 268 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 269 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 270 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 271 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 272 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 273 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 274 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 275 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 276 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 277 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 278 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 279 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 280 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 281 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 282 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 283 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 284 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 285 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 286 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 287 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 288 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 289 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 290 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 291 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 292 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 293 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 294 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 295 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 296 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 297 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 298 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 299 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 300 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 301 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 302 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 303 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 304 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 305 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 306 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 307 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 308 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 309 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 310 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 311 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 312 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 313 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 314 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 315 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 316 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 317 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 318 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 319 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 320 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 321 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 322 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 323 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 324 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 325 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 326 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 327 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 328 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 329 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 330 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 331 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 332 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 333 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 334 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 335 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 336 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 337 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 338 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 339 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 340 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 341 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 342 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 343 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 344 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 345 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 346 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 347 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 348 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 349 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 350 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 351 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 352 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 353 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 354 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 355 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 356 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 357 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 358 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 359 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 360 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 361 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 362 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 363 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 364 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 365 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 366 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 367 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 368 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 369 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 370 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 371 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 372 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 373 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 374 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 375 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 376 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 377 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 378 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 379 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 380 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 381 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 382 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 383 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 384 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 385 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 386 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 387 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 388 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 389 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 390 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 391 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 392 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 393 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 394 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 395 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 396 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 397 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 398 | +E3_core,A1,A1,none,qwen1b5,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 399 | +E3_core,A4|budget_tokens=512|blind,A4,blind,qwen1b5,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 400 | +E3_core,A5|budget_tokens=512|blind,A5,blind,qwen1b5,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 401 | +E3_core,C0,C0,none,qwen1b5,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 402 | +E3_core,C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz,C2,none,qwen1b5,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 403 | +E3_core,C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware,C3,aware,qwen1b5,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
modified
protocol/pilot_matrix.csv
+248 −744
@@ -1,376 +1,252 @@ | ||
| 1 | 1 | experiment_id,condition,method,access,sender,receiver,family,document_id,split,target_tokens,n_questions,seed,expected_trials |
| 2 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 3 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 4 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 5 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 6 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 7 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 8 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 9 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 10 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 11 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 12 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 13 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 14 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 15 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 16 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 17 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 18 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 19 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 20 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 21 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 22 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 23 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 24 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 25 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 26 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 27 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 28 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 29 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 30 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 31 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 32 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 33 | −E1_pilot,A0,A0,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 34 | −E1_pilot,A1,A1,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 35 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 36 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 37 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 38 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 39 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 40 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 41 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 42 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 43 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 44 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 45 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 46 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 47 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 48 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 49 | −E1_pilot,B0,B0,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 50 | −E1_pilot,B1,B1,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 51 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 52 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 53 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 54 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 55 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 56 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 57 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 58 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 59 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 60 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 61 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 62 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 63 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,8,0,8 | |
| 64 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 65 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 66 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 67 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 68 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 69 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 70 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 71 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 72 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 73 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 74 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 75 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 76 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 77 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 78 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 79 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 80 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 81 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 82 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 83 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 84 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 85 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 86 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 87 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 88 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 89 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 90 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 91 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 92 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 93 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 94 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 95 | −E1_pilot,A0,A0,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 96 | −E1_pilot,A1,A1,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 97 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 98 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 99 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 100 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 101 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 102 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 103 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 104 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 105 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 106 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 107 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 108 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 109 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 110 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 111 | −E1_pilot,B0,B0,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 112 | −E1_pilot,B1,B1,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 113 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 114 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 115 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 116 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 117 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 118 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 119 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 120 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 121 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 122 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 123 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 124 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 125 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,8,0,8 | |
| 126 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 127 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 128 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 129 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 130 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 131 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 132 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 133 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 134 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 135 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 136 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 137 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 138 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 139 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 140 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 141 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 142 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 143 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 144 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 145 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 146 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 147 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 148 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 149 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 150 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 151 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 152 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 153 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 154 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 155 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 156 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 157 | −E1_pilot,A0,A0,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 158 | −E1_pilot,A1,A1,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 159 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 160 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 161 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 162 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 163 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 164 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 165 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 166 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 167 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 168 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 169 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 170 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 171 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 172 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 173 | −E1_pilot,B0,B0,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 174 | −E1_pilot,B1,B1,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 175 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 176 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 177 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 178 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 179 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 180 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 181 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 182 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 183 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 184 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 185 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 186 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 187 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,8,0,8 | |
| 188 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 189 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 190 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 191 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 192 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 193 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 194 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 195 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 196 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 197 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 198 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 199 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 200 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 201 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 202 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 203 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 204 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 205 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 206 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 207 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 208 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 209 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 210 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 211 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 212 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 213 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 214 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 215 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 216 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 217 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 218 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 219 | −E1_pilot,A0,A0,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 220 | −E1_pilot,A1,A1,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 221 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 222 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 223 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 224 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 225 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 226 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 227 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 228 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 229 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 230 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 231 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 232 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 233 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 234 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 235 | −E1_pilot,B0,B0,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 236 | −E1_pilot,B1,B1,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 237 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 238 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 239 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 240 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 241 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 242 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 243 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 244 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 245 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 246 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 247 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 248 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 249 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,8,0,8 | |
| 250 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 251 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 252 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 253 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 254 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 255 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 256 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 257 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 258 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 259 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 260 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 261 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 262 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 263 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 264 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 265 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 266 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 267 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 268 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 269 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 270 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 271 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 272 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 273 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 274 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 275 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 276 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 277 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 278 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 279 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 280 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 281 | −E1_pilot,A0,A0,none,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 282 | −E1_pilot,A1,A1,none,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 283 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 284 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 285 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 286 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 287 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 288 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 289 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 290 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 291 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 292 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 293 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 294 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 295 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 296 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 297 | −E1_pilot,B0,B0,none,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 298 | −E1_pilot,B1,B1,none,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 299 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 300 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 301 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 302 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 303 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 304 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 305 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 306 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 307 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 308 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 309 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 310 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 311 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_02006_2000,dev,2000,8,0,8 | |
| 312 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 313 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 314 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 315 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 316 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 317 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 318 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 319 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 320 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 321 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 322 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 323 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 324 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 325 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 326 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 327 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 328 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 329 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 330 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 331 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 332 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 333 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 334 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 335 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 336 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 337 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 338 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 339 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 340 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 341 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 342 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 343 | −E1_pilot,A0,A0,none,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 344 | −E1_pilot,A1,A1,none,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 345 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 346 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 347 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 348 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 349 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 350 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 351 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 352 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 353 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 354 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 355 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 356 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 357 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 358 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 359 | −E1_pilot,B0,B0,none,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 360 | −E1_pilot,B1,B1,none,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 361 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 362 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 363 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 364 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 365 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 366 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 367 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 368 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 369 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 370 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 371 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 372 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 373 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_02007_8000,dev,8000,8,0,8 | |
| 2 | +E1_pilot,A0,A0,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 3 | +E1_pilot,A1,A1,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 4 | +E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 5 | +E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 6 | +E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 7 | +E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 8 | +E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 9 | +E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 10 | +E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 11 | +E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 12 | +E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 13 | +E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 14 | +E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 15 | +E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 16 | +E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 17 | +E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 18 | +E1_pilot,B0,B0,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 19 | +E1_pilot,B1,B1,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 20 | +E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 21 | +E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 22 | +E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 23 | +E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 24 | +E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 25 | +E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 26 | +E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 27 | +E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 28 | +E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 29 | +E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 30 | +E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 31 | +E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 32 | +E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 33 | +E1_pilot,A0,A0,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 34 | +E1_pilot,A1,A1,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 35 | +E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 36 | +E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 37 | +E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 38 | +E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 39 | +E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 40 | +E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 41 | +E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 42 | +E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 43 | +E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 44 | +E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 45 | +E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 46 | +E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 47 | +E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 48 | +E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 49 | +E1_pilot,B0,B0,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 50 | +E1_pilot,B1,B1,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 51 | +E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 52 | +E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 53 | +E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 54 | +E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 55 | +E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 56 | +E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 57 | +E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 58 | +E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 59 | +E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 60 | +E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 61 | +E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 62 | +E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 63 | +E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_02000_2000,dev,2000,5,0,5 | |
| 64 | +E1_pilot,A0,A0,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 65 | +E1_pilot,A1,A1,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 66 | +E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 67 | +E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 68 | +E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 69 | +E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 70 | +E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 71 | +E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 72 | +E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 73 | +E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 74 | +E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 75 | +E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 76 | +E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 77 | +E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 78 | +E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 79 | +E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 80 | +E1_pilot,B0,B0,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 81 | +E1_pilot,B1,B1,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 82 | +E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 83 | +E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 84 | +E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 85 | +E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 86 | +E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 87 | +E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 88 | +E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 89 | +E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 90 | +E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 91 | +E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 92 | +E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 93 | +E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 94 | +E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 95 | +E1_pilot,A0,A0,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 96 | +E1_pilot,A1,A1,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 97 | +E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 98 | +E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 99 | +E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 100 | +E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 101 | +E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 102 | +E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 103 | +E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 104 | +E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 105 | +E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 106 | +E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 107 | +E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 108 | +E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 109 | +E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 110 | +E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 111 | +E1_pilot,B0,B0,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 112 | +E1_pilot,B1,B1,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 113 | +E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 114 | +E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 115 | +E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 116 | +E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 117 | +E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 118 | +E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 119 | +E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 120 | +E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 121 | +E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 122 | +E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 123 | +E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 124 | +E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 125 | +E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 | |
| 126 | +E1_pilot,A0,A0,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 127 | +E1_pilot,A1,A1,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 128 | +E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 129 | +E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 130 | +E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 131 | +E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 132 | +E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 133 | +E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 134 | +E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 135 | +E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 136 | +E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 137 | +E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 138 | +E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 139 | +E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 140 | +E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 141 | +E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 142 | +E1_pilot,B0,B0,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 143 | +E1_pilot,B1,B1,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 144 | +E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 145 | +E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 146 | +E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 147 | +E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 148 | +E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 149 | +E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 150 | +E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 151 | +E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 152 | +E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 153 | +E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 154 | +E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 155 | +E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 156 | +E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 157 | +E1_pilot,A0,A0,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 158 | +E1_pilot,A1,A1,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 159 | +E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 160 | +E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 161 | +E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 162 | +E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 163 | +E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 164 | +E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 165 | +E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 166 | +E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 167 | +E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 168 | +E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 169 | +E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 170 | +E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 171 | +E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 172 | +E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 173 | +E1_pilot,B0,B0,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 174 | +E1_pilot,B1,B1,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 175 | +E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 176 | +E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 177 | +E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 178 | +E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 179 | +E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 180 | +E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 181 | +E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 182 | +E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 183 | +E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 184 | +E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 185 | +E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 186 | +E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 187 | +E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 188 | +E1_pilot,A0,A0,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 189 | +E1_pilot,A1,A1,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 190 | +E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 191 | +E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 192 | +E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 193 | +E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 194 | +E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 195 | +E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 196 | +E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 197 | +E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 198 | +E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 199 | +E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 200 | +E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 201 | +E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 202 | +E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 203 | +E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 204 | +E1_pilot,B0,B0,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 205 | +E1_pilot,B1,B1,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 206 | +E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 207 | +E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 208 | +E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 209 | +E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 210 | +E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 211 | +E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 212 | +E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 213 | +E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 214 | +E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 215 | +E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 216 | +E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 217 | +E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 218 | +E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 219 | +E1_pilot,A0,A0,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 220 | +E1_pilot,A1,A1,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 221 | +E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 222 | +E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 223 | +E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 224 | +E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 225 | +E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 226 | +E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 227 | +E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 228 | +E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 229 | +E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 230 | +E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 231 | +E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 232 | +E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 233 | +E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 234 | +E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 235 | +E1_pilot,B0,B0,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 236 | +E1_pilot,B1,B1,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 237 | +E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 238 | +E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 239 | +E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 240 | +E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 241 | +E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 242 | +E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 243 | +E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 244 | +E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 245 | +E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 246 | +E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 247 | +E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 248 | +E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 249 | +E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 374 | 250 | E1_pilot,A0,A0,none,qwen3b,qwen3b,exec,exec_00101_2000,dev,,1,0,1 |
| 375 | 251 | E1_pilot,A1,A1,none,qwen3b,qwen3b,exec,exec_00101_2000,dev,,1,0,1 |
| 376 | 252 | E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,exec,exec_00101_2000,dev,,1,0,1 |
@@ -619,130 +495,6 @@ E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,exec,exec_00104_2000, | ||
| 619 | 495 | E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 |
| 620 | 496 | E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 |
| 621 | 497 | E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 |
| 622 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 623 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 624 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 625 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 626 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 627 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 628 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 629 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 630 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 631 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 632 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 633 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 634 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 635 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 636 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 637 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 638 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 639 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 640 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 641 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 642 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 643 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 644 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 645 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 646 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 647 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 648 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 649 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 650 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 651 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 652 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 653 | −E1_pilot,A0,A0,none,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 654 | −E1_pilot,A1,A1,none,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 655 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 656 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 657 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 658 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 659 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 660 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 661 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 662 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 663 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 664 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 665 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 666 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 667 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 668 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 669 | −E1_pilot,B0,B0,none,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 670 | −E1_pilot,B1,B1,none,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 671 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 672 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 673 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 674 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 675 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 676 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 677 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 678 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 679 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 680 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 681 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 682 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 683 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00105_2000,dev,,1,0,1 | |
| 684 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 685 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 686 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 687 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 688 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 689 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 690 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 691 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 692 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 693 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 694 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 695 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 696 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 697 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 698 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 699 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 700 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 701 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 702 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 703 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 704 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 705 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 706 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 707 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 708 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 709 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 710 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 711 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 712 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 713 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 714 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 715 | −E1_pilot,A0,A0,none,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 716 | −E1_pilot,A1,A1,none,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 717 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 718 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 719 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 720 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 721 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 722 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 723 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 724 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 725 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 726 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 727 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 728 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 729 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 730 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 731 | −E1_pilot,B0,B0,none,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 732 | −E1_pilot,B1,B1,none,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 733 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 734 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 735 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 736 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 737 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 738 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 739 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 740 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 741 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 742 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 743 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 744 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 745 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00106_2000,dev,,1,0,1 | |
| 746 | 498 | E1_pilot,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084,dev,,1,0,1 |
| 747 | 499 | E1_pilot,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084,dev,,1,0,1 |
| 748 | 500 | E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084,dev,,1,0,1 |
@@ -991,130 +743,6 @@ E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasp | ||
| 991 | 743 | E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 |
| 992 | 744 | E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 |
| 993 | 745 | E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 |
| 994 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 995 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 996 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 997 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 998 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 999 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1000 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1001 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1002 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1003 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1004 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1005 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1006 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1007 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1008 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1009 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1010 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1011 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1012 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1013 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1014 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1015 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1016 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1017 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1018 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1019 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1020 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1021 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1022 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1023 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1024 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1025 | −E1_pilot,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1026 | −E1_pilot,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1027 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1028 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1029 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1030 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1031 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1032 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1033 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1034 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1035 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1036 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1037 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1038 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1039 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1040 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1041 | −E1_pilot,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1042 | −E1_pilot,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1043 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1044 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1045 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1046 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1047 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1048 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1049 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1050 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1051 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1052 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1053 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1054 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1055 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_3b069a546d5417be546f57d02981cf5ac68b4d3d6c55624a,dev,,1,0,1 | |
| 1056 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1057 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1058 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1059 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1060 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1061 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1062 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1063 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1064 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1065 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1066 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1067 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1068 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1069 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1070 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1071 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1072 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1073 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1074 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1075 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1076 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1077 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1078 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1079 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1080 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1081 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1082 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1083 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1084 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1085 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1086 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1087 | −E1_pilot,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1088 | −E1_pilot,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1089 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1090 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1091 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1092 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1093 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1094 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1095 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1096 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1097 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1098 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1099 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1100 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1101 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1102 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1103 | −E1_pilot,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1104 | −E1_pilot,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1105 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1106 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1107 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1108 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1109 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1110 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1111 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1112 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1113 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1114 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1115 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1116 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1117 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_091b4028a3b5e9d8248c58f17a62fd16c878da69693cfbfb,dev,,1,0,1 | |
| 1118 | 746 | E1_pilot,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53,dev,,1,0,1 |
| 1119 | 747 | E1_pilot,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53,dev,,1,0,1 |
| 1120 | 748 | E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53,dev,,1,0,1 |
@@ -1363,127 +991,3 @@ E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2w | ||
| 1363 | 991 | E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 |
| 1364 | 992 | E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 |
| 1365 | 993 | E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 |
| 1366 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1367 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1368 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1369 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1370 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1371 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1372 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1373 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1374 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1375 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1376 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1377 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1378 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1379 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1380 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1381 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1382 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1383 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1384 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1385 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1386 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1387 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1388 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1389 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1390 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1391 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1392 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1393 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1394 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1395 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1396 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1397 | −E1_pilot,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1398 | −E1_pilot,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1399 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1400 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1401 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1402 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1403 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1404 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1405 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1406 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1407 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1408 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1409 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1410 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1411 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1412 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1413 | −E1_pilot,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1414 | −E1_pilot,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1415 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1416 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1417 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1418 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1419 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1420 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1421 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1422 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1423 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1424 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1425 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1426 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1427 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2a398d925d3607c94ffb2d0cf9fe2fe6da6e9970ce95578a,dev,,1,0,1 | |
| 1428 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1429 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1430 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1431 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1432 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1433 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1434 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1435 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1436 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1437 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1438 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1439 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1440 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1441 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1442 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1443 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1444 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1445 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1446 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1447 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1448 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1449 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1450 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1451 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1452 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1453 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1454 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1455 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1456 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1457 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1458 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1459 | −E1_pilot,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1460 | −E1_pilot,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1461 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1462 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1463 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1464 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1465 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1466 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1467 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1468 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1469 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1470 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1471 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1472 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1473 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1474 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1475 | −E1_pilot,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1476 | −E1_pilot,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1477 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1478 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1479 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1480 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1481 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1482 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1483 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1484 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1485 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1486 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1487 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1488 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
| 1489 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4413705182b57f12dc553e0919b50fd3c3b111cb4d82d12f,dev,,1,0,1 | |
added
results/tables/table1_taxonomy.csv
+26 −0
@@ -0,0 +1,26 @@ | ||
| 1 | +id,representation,question_access,training,compatibility,composable,status_in_wp30 | |
| 2 | +A0,none (task only),n/a,none,any,n/a,measured | |
| 3 | +A1,raw text,blind,none,any receiver,concatenation,measured | |
| 4 | +A2,text head/tail,blind,none,any,concatenation,measured | |
| 5 | +A3,extractive sentences (BM25/centrality),blind or aware,none,any,concatenation,measured | |
| 6 | +A4,abstractive summary,blind or aware,none (prompted sender),any,concatenation,measured | |
| 7 | +A5,typed facts + source spans + unknowns (JSON),blind or aware,none (prompted sender),any,record merge,measured | |
| 8 | +A6,reference index + metered retrieval,"blind index, aware retrieval",none,any + source access,shared memory,measured | |
| 9 | +A7,"raw text, zstd transport codec",blind,none,any,concatenation,measured | |
| 10 | +A8,LLMLingua-2 token dropping,blind,pretrained compressor (official),any,concatenation,measured | |
| 11 | +B0,native bf16 KV cache,blind,none,same checkpoint,no,measured | |
| 12 | +B1,serialized KV cache (manifest-checked),blind,none,same checkpoint + revision,no,measured (process + 2-node) | |
| 13 | +B2,packed quantized KV (8/4/2 bit),blind,none,same checkpoint,no,measured | |
| 14 | +B3,sink+recent retention (StreamingLLM-inspired),blind,none,same checkpoint,no,measured | |
| 15 | +B4,random retention (control),blind,none,same checkpoint,no,measured | |
| 16 | +B5,attention-informed retention (SnapKV rule),aware (blind variant tested),none,same checkpoint,no,measured | |
| 17 | +B6,pyramid layer budgets (PyramidKV rule),aware,none,same checkpoint,no,measured | |
| 18 | +B9,selection then packed quantization,aware,none,same checkpoint,no,measured | |
| 19 | +C0,sender cache fed as receiver cache,blind,none,incompatible (negative control),no,measured (control) | |
| 20 | +C2,"linear KV mapper (ridge, un-rotated K/V)",blind,ridge on train caches,trained pair (Qwen 1.5B→3B),no,measured | |
| 21 | +C3,mapper + attention selection,aware,ridge on train caches,trained pair,no,measured | |
| 22 | +—,SwaT cross-family mapper,blind,~300M mapper (not public),Granite→SmolLM,no,not run: no checkpoint/licence | |
| 23 | +—,Attention-Matching compaction,blind,none (optimization),same model,no,not run: CUDA/vLLM code; MLX port out of scope | |
| 24 | +—,C2C fuser,blind,released fusers (Qwen3),Qwen3 receivers,no,not run: CUDA; receiver still prefills source | |
| 25 | +—,H2O eviction,cumulative,none,same checkpoint,no,not run: requires attention scores during whole prefill | |
| 26 | +—,KIVI per-channel key quantization,blind,none,same checkpoint,no,not run: CUDA kernels; motivation confirmed by B2 Qwen result | |
added
results/tables/table2_models.csv
+4 −0
@@ -0,0 +1,4 @@ | ||
| 1 | +alias,repo,revision,family,layers,kv_heads,q_heads,head_dim,weights,max_pos,rope_theta,cache_bytes_per_token_bf16,prefill_ms_8k,prefill_ms_16k,mlx,mlx_lm | |
| 2 | +qwen3b,mlx-community/Qwen2.5-3B-Instruct-bf16,bec1ad658e38,qwen2,36,2,16,128,bfloat16,32768,1000000.0,36864,968,2286,0.32.4,0.32.2 | |
| 3 | +llama3b,mlx-community/Llama-3.2-3B-Instruct-bf16,6d88ba43024f,llama,28,8,24,128,bfloat16,131072,500000.0,114688,1007,2449,0.32.4,0.32.2 | |
| 4 | +qwen1b5,mlx-community/Qwen2.5-1.5B-Instruct-bf16,4ae77cb209f0,qwen2,28,2,12,128,bfloat16,32768,1000000.0,28672,494,1201,0.32.4,0.32.2 | |
added
results/tables/table3_datasets.csv
+13 −0
@@ -0,0 +1,13 @@ | ||
| 1 | +family,split,documents,questions,median_chars | |
| 2 | +exec,dev,30,30,7847.0 | |
| 3 | +exec,test,40,40,7817.0 | |
| 4 | +exec,train,20,20,7865.5 | |
| 5 | +public_2wikimqa,dev,56,56,25419.0 | |
| 6 | +public_2wikimqa,test,144,144,25488.5 | |
| 7 | +public_hotpotqa,dev,61,61,65814.0 | |
| 8 | +public_hotpotqa,test,139,139,60944.0 | |
| 9 | +public_qasper,dev,50,50,19843.5 | |
| 10 | +public_qasper,test,150,150,23154.0 | |
| 11 | +synthetic,dev,30,450,29225.0 | |
| 12 | +synthetic,test,40,600,29203.0 | |
| 13 | +synthetic,train,40,600,29196.5 | |
added
runs/raw/E1_pilot.jsonl
+280 −0
@@ -0,0 +1,280 @@ | ||
| 1 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7dc471c38e2b7b3349fd80b1", "attempt_id": "14fab3a71a89", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:44.789151Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 64, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0037919962778687477, "decode_payload_ms": 0.0, "receiver_prefill_ms": 67.28591700084507, "ttft_ms": 28.43649999704212, "decode_ms": 46.75175005104393}, "total_wall_ms": 149.4781249202788, "ttft_ms": 28.43649999704212, "input_usage": {"receiver_prompt_tokens": 64}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6596116480, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6221848952, "mlx_cache_bytes": 52763976, "process_rss_bytes": 6596116480}, "peak_prefill_memory": null, "peak_decode_memory": 6221848952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 2 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1d905b8a74595c32f476900e", "attempt_id": "1c6956028bb4", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:44.969183Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 70, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0037919962778687477, "decode_payload_ms": 0.0, "receiver_prefill_ms": 58.32883401308209, "ttft_ms": 19.682042067870498, "decode_ms": 20.957999979145825}, "total_wall_ms": 99.59383402019739, "ttft_ms": 19.682042067870498, "input_usage": {"receiver_prompt_tokens": 70}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6596755456, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6243967624, "mlx_cache_bytes": 117202248, "process_rss_bytes": 6596755456}, "peak_prefill_memory": null, "peak_decode_memory": 6243967624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 3 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f37452a7ec7d3067f51b5c24", "attempt_id": "79b1670bf9b1", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:45.091440Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 70, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0037919962778687477, "decode_payload_ms": 0.0, "receiver_prefill_ms": 61.44025002140552, "ttft_ms": 24.80645792093128, "decode_ms": 26.245958055369556}, "total_wall_ms": 113.10295900329947, "ttft_ms": 24.80645792093128, "input_usage": {"receiver_prompt_tokens": 70}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6596804608, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6243967624, "mlx_cache_bytes": 117202248, "process_rss_bytes": 6596804608}, "peak_prefill_memory": null, "peak_decode_memory": 6243967624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 4 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f9edb4468f6549f800cb524f", "attempt_id": "ee5214112780", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:45.225288Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 67, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0037919962778687477, "decode_payload_ms": 0.0, "receiver_prefill_ms": 67.30499991681427, "ttft_ms": 32.58833289146423, "decode_ms": 36.201750044710934}, "total_wall_ms": 136.73595804721117, "ttft_ms": 32.58833289146423, "input_usage": {"receiver_prompt_tokens": 67}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6596853760, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6245671560, "mlx_cache_bytes": 162225480, "process_rss_bytes": 6596853760}, "peak_prefill_memory": null, "peak_decode_memory": 6245671560, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 5 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c0871b617f7308d16b328999", "attempt_id": "fae12c47b397", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:45.385364Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 75, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0037919962778687477, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.22470802254975, "ttft_ms": 33.77595904748887, "decode_ms": 42.92874992825091}, "total_wall_ms": 129.70216700341552, "ttft_ms": 33.77595904748887, "input_usage": {"receiver_prompt_tokens": 75}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6596935680, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6248243848, "mlx_cache_bytes": 229399880, "process_rss_bytes": 6596935680}, "peak_prefill_memory": null, "peak_decode_memory": 6248243848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 6 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "464bd186ad7ef93f726fca6f", "attempt_id": "0435daa0a044", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:45.539311Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 73, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0037919962778687477, "decode_payload_ms": 0.0, "receiver_prefill_ms": 40.481833973899484, "ttft_ms": 40.42075003962964, "decode_ms": 27.114708092994988}, "total_wall_ms": 108.66475000511855, "ttft_ms": 40.42075003962964, "input_usage": {"receiver_prompt_tokens": 73}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6596968448, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6245720712, "mlx_cache_bytes": 273931592, "process_rss_bytes": 6596968448}, "peak_prefill_memory": null, "peak_decode_memory": 6245720712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9994f97a49ef7eaa65bab903", "attempt_id": "1d797d30b8c8", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:45.671539Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 67, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0037919962778687477, "decode_payload_ms": 0.0, "receiver_prefill_ms": 68.87345795985311, "ttft_ms": 45.527375070378184, "decode_ms": 43.627374921925366}, "total_wall_ms": 158.86070800479501, "ttft_ms": 45.527375070378184, "input_usage": {"receiver_prompt_tokens": 67}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6596968448, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6245016200, "mlx_cache_bytes": 273931592, "process_rss_bytes": 6596968448}, "peak_prefill_memory": null, "peak_decode_memory": 6245016200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 8 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "43f1a24e11e8b198cbef5618", "attempt_id": "49aff4d1d2ff", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:45.852745Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 65, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0037919962778687477, "decode_payload_ms": 0.0, "receiver_prefill_ms": 39.54058396629989, "ttft_ms": 28.165541007183492, "decode_ms": 48.47637505736202}, "total_wall_ms": 116.93983396980911, "ttft_ms": 28.165541007183492, "input_usage": {"receiver_prompt_tokens": 65}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6597197824, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6222143868, "mlx_cache_bytes": 299294280, "process_rss_bytes": 6597197824}, "peak_prefill_memory": null, "peak_decode_memory": 6222143868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 9 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "11825e5d5dd2e833533d1165", "attempt_id": "3c1154222a5d", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:45.992502Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2045, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.025416957214474678, "decode_payload_ms": 0.0, "receiver_prefill_ms": 432.08558403421193, "ttft_ms": 54.78208290878683, "decode_ms": 402.40779099985957}, "total_wall_ms": 892.7009999752045, "ttft_ms": 54.78208290878683, "input_usage": {"receiver_prompt_tokens": 2045}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 6597492736, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7061651504, "mlx_cache_bytes": 1280966200, "process_rss_bytes": 6597492736}, "peak_prefill_memory": null, "peak_decode_memory": 7061651504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 10 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3633111fe7fdc73136eda5d9", "attempt_id": "0df61f4443d6", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:46.908866Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2051, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.025416957214474678, "decode_payload_ms": 0.0, "receiver_prefill_ms": 539.7673329571262, "ttft_ms": 38.68245903868228, "decode_ms": 330.514750094153}, "total_wall_ms": 912.8277080599219, "ttft_ms": 38.68245903868228, "input_usage": {"receiver_prompt_tokens": 2051}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6598033408, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7054786612, "mlx_cache_bytes": 2087045696, "process_rss_bytes": 6598033408}, "peak_prefill_memory": null, "peak_decode_memory": 7054786612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "b6582a041b3d2b38ac6924099568ca2e6f1a610c6fb5f4de2e0516b90433bc2a"} | |
| 11 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c9ac4078f6630b453fba0e5e", "attempt_id": "3807587f966d", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:47.844390Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2051, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.025416957214474678, "decode_payload_ms": 0.0, "receiver_prefill_ms": 542.4670829670504, "ttft_ms": 48.275374923832715, "decode_ms": 218.9682919997722}, "total_wall_ms": 812.990834005177, "ttft_ms": 48.275374923832715, "input_usage": {"receiver_prompt_tokens": 2051}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 6598049792, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7054786612, "mlx_cache_bytes": 2087045696, "process_rss_bytes": 6598049792}, "peak_prefill_memory": null, "peak_decode_memory": 7054786612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 12 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "acbf2d57d99baa3bb3291022", "attempt_id": "ff4ce199181e", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:48.680247Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2048, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.025416957214474678, "decode_payload_ms": 0.0, "receiver_prefill_ms": 473.96037506405264, "ttft_ms": 42.49712498858571, "decode_ms": 155.7709170738235}, "total_wall_ms": 675.7320000324398, "ttft_ms": 42.49712498858571, "input_usage": {"receiver_prompt_tokens": 2048}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 6598082560, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7063175232, "mlx_cache_bytes": 2087045696, "process_rss_bytes": 6598082560}, "peak_prefill_memory": null, "peak_decode_memory": 7063175232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 13 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5ab2626e677fad777c044d90", "attempt_id": "48c57eec76c8", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:49.377114Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2056, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.025416957214474678, "decode_payload_ms": 0.0, "receiver_prefill_ms": 907.967249979265, "ttft_ms": 39.17491703759879, "decode_ms": 261.24666596297175}, "total_wall_ms": 1211.6929580224678, "ttft_ms": 39.17491703759879, "input_usage": {"receiver_prompt_tokens": 2056}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 6599262208, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7054794796, "mlx_cache_bytes": 2092188669, "process_rss_bytes": 6599262208}, "peak_prefill_memory": null, "peak_decode_memory": 7054794796, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6889172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "adcb8d196080006451756ad2fe2106d5a1b6500c0f76ffaa05d7fe704243ad3b"} | |
| 14 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a34269d1bed9a1a8e01f5409", "attempt_id": "5cb8306ef833", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:50.610885Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2054, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.025416957214474678, "decode_payload_ms": 0.0, "receiver_prefill_ms": 585.719499969855, "ttft_ms": 49.6917919954285, "decode_ms": 364.57666708156466}, "total_wall_ms": 1003.0161670874804, "ttft_ms": 49.6917919954285, "input_usage": {"receiver_prompt_tokens": 2054}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 6599442432, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7054792797, "mlx_cache_bytes": 2095285245, "process_rss_bytes": 6599442432}, "peak_prefill_memory": null, "peak_decode_memory": 7054792797, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SP-38G-4217", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "e643c21a78559b96fd65325d9ce779b7b8fd6a47c53cf7c2cda1efa8412458c4"} | |
| 15 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "fc45c178aa497c4f2856a0ea", "attempt_id": "55e138743342", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:51.634835Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2048, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.025416957214474678, "decode_payload_ms": 0.0, "receiver_prefill_ms": 491.39533401466906, "ttft_ms": 49.010332906618714, "decode_ms": 45.80304108094424}, "total_wall_ms": 589.230666984804, "ttft_ms": 49.010332906618714, "input_usage": {"receiver_prompt_tokens": 2048}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6599409664, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7063175232, "mlx_cache_bytes": 2095285245, "process_rss_bytes": 6599409664}, "peak_prefill_memory": null, "peak_decode_memory": 7063175232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 16 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "520ca0673d257e517a5c275d", "attempt_id": "c34d0296c49e", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:52.245014Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2046, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.025416957214474678, "decode_payload_ms": 0.0, "receiver_prefill_ms": 511.2538749817759, "ttft_ms": 48.41466702055186, "decode_ms": 39.59991701412946}, "total_wall_ms": 602.9183330247179, "ttft_ms": 48.41466702055186, "input_usage": {"receiver_prompt_tokens": 2046}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6599426048, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7062388800, "mlx_cache_bytes": 2656535549, "process_rss_bytes": 6599426048}, "peak_prefill_memory": null, "peak_decode_memory": 7062388800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 17 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "906fb78d7fdd8a3d40b151e6", "attempt_id": "24501095d4d9", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:52.870086Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 1971}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 211, "message_tokens": 132, "message_utf8_bytes": 699, "cache_tensor_bytes": null, "serialized_payload_bytes": 699, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.3587919529527426, "decode_payload_ms": 0.0, "receiver_prefill_ms": 85.79641696996987, "ttft_ms": 45.009916997514665, "decode_ms": 44.92799995932728}, "total_wall_ms": 176.73458298668265, "ttft_ms": 45.009916997514665, "input_usage": {"receiver_prompt_tokens": 211}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6599589888, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6351512688, "mlx_cache_bytes": 2829091837, "process_rss_bytes": 6599589888}, "peak_prefill_memory": null, "peak_decode_memory": 6351512688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0b02f3343692bbb81db58494f929605d06dd28b19633a0be78255fe46e31eef8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 18 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6f069850606433588d01f4e0", "attempt_id": "c31134f6f532", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:53.068486Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 1971}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 217, "message_tokens": 132, "message_utf8_bytes": 699, "cache_tensor_bytes": null, "serialized_payload_bytes": 699, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.3587919529527426, "decode_payload_ms": 0.0, "receiver_prefill_ms": 63.218874973244965, "ttft_ms": 24.810667033307254, "decode_ms": 34.904666943475604}, "total_wall_ms": 123.8859590375796, "ttft_ms": 24.810667033307254, "input_usage": {"receiver_prompt_tokens": 217}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6599737344, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6354969712, "mlx_cache_bytes": 2997617661, "process_rss_bytes": 6599737344}, "peak_prefill_memory": null, "peak_decode_memory": 6354969712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0b02f3343692bbb81db58494f929605d06dd28b19633a0be78255fe46e31eef8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 19 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "404c6444eaa7eb6f037de747", "attempt_id": "58cb78b10461", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:53.212599Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 1971}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 217, "message_tokens": 132, "message_utf8_bytes": 699, "cache_tensor_bytes": null, "serialized_payload_bytes": 699, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.3587919529527426, "decode_payload_ms": 0.0, "receiver_prefill_ms": 105.49899993930012, "ttft_ms": 50.18529191147536, "decode_ms": 29.159959056414664}, "total_wall_ms": 185.97908306401223, "ttft_ms": 50.18529191147536, "input_usage": {"receiver_prompt_tokens": 217}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6599753728, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6354936944, "mlx_cache_bytes": 2997732349, "process_rss_bytes": 6599753728}, "peak_prefill_memory": null, "peak_decode_memory": 6354936944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0b02f3343692bbb81db58494f929605d06dd28b19633a0be78255fe46e31eef8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 20 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f901d2b005bb9fd0a72aaa1b", "attempt_id": "be966da27525", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:53.421240Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 1971}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 214, "message_tokens": 132, "message_utf8_bytes": 699, "cache_tensor_bytes": null, "serialized_payload_bytes": 699, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.3587919529527426, "decode_payload_ms": 0.0, "receiver_prefill_ms": 93.52445893455297, "ttft_ms": 44.21774996444583, "decode_ms": 34.86170805990696}, "total_wall_ms": 173.7389590125531, "ttft_ms": 44.21774996444583, "input_usage": {"receiver_prompt_tokens": 214}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6599802880, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6353364080, "mlx_cache_bytes": 3114910717, "process_rss_bytes": 6599802880}, "peak_prefill_memory": null, "peak_decode_memory": 6353364080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0b02f3343692bbb81db58494f929605d06dd28b19633a0be78255fe46e31eef8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 21 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a161f0e343ce3de65a917bbf", "attempt_id": "96b92663c87f", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:53.617102Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 1971}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 222, "message_tokens": 132, "message_utf8_bytes": 699, "cache_tensor_bytes": null, "serialized_payload_bytes": 699, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.3587919529527426, "decode_payload_ms": 0.0, "receiver_prefill_ms": 90.69304203148931, "ttft_ms": 40.12424999382347, "decode_ms": 19.014084013178945}, "total_wall_ms": 150.86395805701613, "ttft_ms": 40.12424999382347, "input_usage": {"receiver_prompt_tokens": 222}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6599950336, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6359639152, "mlx_cache_bytes": 3290874877, "process_rss_bytes": 6599950336}, "peak_prefill_memory": null, "peak_decode_memory": 6359639152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0b02f3343692bbb81db58494f929605d06dd28b19633a0be78255fe46e31eef8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 22 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ded82344b0d28af77a17b2a7", "attempt_id": "8f7189ac5427", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:53.788710Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 1971}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 220, "message_tokens": 132, "message_utf8_bytes": 699, "cache_tensor_bytes": null, "serialized_payload_bytes": 699, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.3587919529527426, "decode_payload_ms": 0.0, "receiver_prefill_ms": 87.39187498576939, "ttft_ms": 40.889833006076515, "decode_ms": 30.488165910355747}, "total_wall_ms": 160.004667006433, "ttft_ms": 40.889833006076515, "input_usage": {"receiver_prompt_tokens": 220}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6599983104, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6368421024, "mlx_cache_bytes": 3423044605, "process_rss_bytes": 6599983104}, "peak_prefill_memory": null, "peak_decode_memory": 6368421024, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0b02f3343692bbb81db58494f929605d06dd28b19633a0be78255fe46e31eef8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 23 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ea3b8f591da6e3155447d060", "attempt_id": "afc053260c19", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:53.969958Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 1971}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 214, "message_tokens": 132, "message_utf8_bytes": 699, "cache_tensor_bytes": null, "serialized_payload_bytes": 699, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.3587919529527426, "decode_payload_ms": 0.0, "receiver_prefill_ms": 105.75333295855671, "ttft_ms": 52.02795809600502, "decode_ms": 43.225124944001436}, "total_wall_ms": 202.0414579892531, "ttft_ms": 52.02795809600502, "input_usage": {"receiver_prompt_tokens": 214}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6599999488, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6353364080, "mlx_cache_bytes": 3423044605, "process_rss_bytes": 6599999488}, "peak_prefill_memory": null, "peak_decode_memory": 6353364080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0b02f3343692bbb81db58494f929605d06dd28b19633a0be78255fe46e31eef8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 24 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "83b17fd24c578f699db39b3a", "attempt_id": "1f3b6c9718a3", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:54.193435Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 1971}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 212, "message_tokens": 132, "message_utf8_bytes": 699, "cache_tensor_bytes": null, "serialized_payload_bytes": 699, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.3587919529527426, "decode_payload_ms": 0.0, "receiver_prefill_ms": 97.247791942209, "ttft_ms": 36.42241598572582, "decode_ms": 36.45654104184359}, "total_wall_ms": 171.1676249979064, "ttft_ms": 36.42241598572582, "input_usage": {"receiver_prompt_tokens": 212}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600048640, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6351889520, "mlx_cache_bytes": 3539043325, "process_rss_bytes": 6600048640}, "peak_prefill_memory": null, "peak_decode_memory": 6351889520, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0b02f3343692bbb81db58494f929605d06dd28b19633a0be78255fe46e31eef8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 25 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9b506313b76f2583b6cb80ba", "attempt_id": "ec96216e8079", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:54.388890Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 1971}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 595, "message_tokens": 516, "message_utf8_bytes": 1775, "cache_tensor_bytes": null, "serialized_payload_bytes": 1775, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8415419617667794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 154.8532920423895, "ttft_ms": 47.15045797638595, "decode_ms": 48.25195798184723}, "total_wall_ms": 251.66629196610302, "ttft_ms": 47.15045797638595, "input_usage": {"receiver_prompt_tokens": 595}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600310784, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6566965336, "mlx_cache_bytes": 3929310205, "process_rss_bytes": 6600310784}, "peak_prefill_memory": null, "peak_decode_memory": 6566965336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d2f5c011b1bc04cde05fd53e8eda8cce4f41dc708c77ba1e0b49bd3fb47d3958", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 26 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9a57c4eb2ccc504dc3633552", "attempt_id": "597ce72eb6d4", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:54.663487Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 1971}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 601, "message_tokens": 516, "message_utf8_bytes": 1775, "cache_tensor_bytes": null, "serialized_payload_bytes": 1775, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8415419617667794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 181.21874995995313, "ttft_ms": 44.996040989644825, "decode_ms": 329.73024994134903}, "total_wall_ms": 557.47912498191, "ttft_ms": 44.996040989644825, "input_usage": {"receiver_prompt_tokens": 601}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6600441856, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6567653464, "mlx_cache_bytes": 4279665661, "process_rss_bytes": 6600441856}, "peak_prefill_memory": null, "peak_decode_memory": 6567653464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C in Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d2f5c011b1bc04cde05fd53e8eda8cce4f41dc708c77ba1e0b49bd3fb47d3958", "output_hash": "3491362e6ed6bb557ea2c25e29286d6fdbd0a0a36995d38446eddfd8450e097c"} | |
| 27 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4adda635e44bb416765ff4c4", "attempt_id": "11c2f6904d48", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:55.242397Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 1971}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 601, "message_tokens": 516, "message_utf8_bytes": 1775, "cache_tensor_bytes": null, "serialized_payload_bytes": 1775, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8415419617667794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 171.44183290656656, "ttft_ms": 42.17550007160753, "decode_ms": 41.338249924592674}, "total_wall_ms": 256.42637501005083, "ttft_ms": 42.17550007160753, "input_usage": {"receiver_prompt_tokens": 601}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600491008, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6567653464, "mlx_cache_bytes": 4279665661, "process_rss_bytes": 6600491008}, "peak_prefill_memory": null, "peak_decode_memory": 6567653464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d2f5c011b1bc04cde05fd53e8eda8cce4f41dc708c77ba1e0b49bd3fb47d3958", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 28 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "b88d04948c6076d6b1e74562", "attempt_id": "38670f80572e", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:55.520316Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 1971}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 598, "message_tokens": 516, "message_utf8_bytes": 1775, "cache_tensor_bytes": null, "serialized_payload_bytes": 1775, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8415419617667794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 168.28325006645173, "ttft_ms": 42.49120794702321, "decode_ms": 53.93745796754956}, "total_wall_ms": 266.03237504605204, "ttft_ms": 42.49120794702321, "input_usage": {"receiver_prompt_tokens": 598}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600507392, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6568931416, "mlx_cache_bytes": 4525622269, "process_rss_bytes": 6600507392}, "peak_prefill_memory": null, "peak_decode_memory": 6568931416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d2f5c011b1bc04cde05fd53e8eda8cce4f41dc708c77ba1e0b49bd3fb47d3958", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 29 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "43812728b5c270b829d4f9ce", "attempt_id": "038b0bcc29f7", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:55.807395Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 1971}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 606, "message_tokens": 516, "message_utf8_bytes": 1775, "cache_tensor_bytes": null, "serialized_payload_bytes": 1775, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8415419617667794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 179.05437492299825, "ttft_ms": 30.108542065136135, "decode_ms": 365.62775005586445}, "total_wall_ms": 576.2662909692153, "ttft_ms": 30.108542065136135, "input_usage": {"receiver_prompt_tokens": 606}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6600540160, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6571159640, "mlx_cache_bytes": 4894262269, "process_rss_bytes": 6600540160}, "peak_prefill_memory": null, "peak_decode_memory": 6571159640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d2f5c011b1bc04cde05fd53e8eda8cce4f41dc708c77ba1e0b49bd3fb47d3958", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 30 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2bfef06d645d76d7f74dd897", "attempt_id": "1e7e8299b397", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:56.404836Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 1971}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 604, "message_tokens": 516, "message_utf8_bytes": 1775, "cache_tensor_bytes": null, "serialized_payload_bytes": 1775, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8415419617667794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 197.55854201503098, "ttft_ms": 35.68808303680271, "decode_ms": 27.315416955389082}, "total_wall_ms": 262.4514999333769, "ttft_ms": 35.68808303680271, "input_usage": {"receiver_prompt_tokens": 604}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600572928, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6585266264, "mlx_cache_bytes": 5164942333, "process_rss_bytes": 6600572928}, "peak_prefill_memory": null, "peak_decode_memory": 6585266264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d2f5c011b1bc04cde05fd53e8eda8cce4f41dc708c77ba1e0b49bd3fb47d3958", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 31 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "749a10f41570225b4bb45f60", "attempt_id": "e88897f5be11", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:56.690208Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 1971}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 598, "message_tokens": 516, "message_utf8_bytes": 1775, "cache_tensor_bytes": null, "serialized_payload_bytes": 1775, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8415419617667794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 195.7303750095889, "ttft_ms": 37.23991697188467, "decode_ms": 33.89962494838983}, "total_wall_ms": 268.46675004344434, "ttft_ms": 37.23991697188467, "input_usage": {"receiver_prompt_tokens": 598}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600572928, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6568931416, "mlx_cache_bytes": 5164942333, "process_rss_bytes": 6600572928}, "peak_prefill_memory": null, "peak_decode_memory": 6568931416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d2f5c011b1bc04cde05fd53e8eda8cce4f41dc708c77ba1e0b49bd3fb47d3958", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 32 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6ccb56e1b78581aa65d29afd", "attempt_id": "41e0321def09", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:56.982992Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 1971}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 596, "message_tokens": 516, "message_utf8_bytes": 1775, "cache_tensor_bytes": null, "serialized_payload_bytes": 1775, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8415419617667794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 206.1636250000447, "ttft_ms": 52.30099998880178, "decode_ms": 22.620375035330653}, "total_wall_ms": 282.57141599897295, "ttft_ms": 52.30099998880178, "input_usage": {"receiver_prompt_tokens": 596}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600605696, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6567358552, "mlx_cache_bytes": 5410014205, "process_rss_bytes": 6600605696}, "peak_prefill_memory": null, "peak_decode_memory": 6567358552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d2f5c011b1bc04cde05fd53e8eda8cce4f41dc708c77ba1e0b49bd3fb47d3958", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 33 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2d52bb8506077d32b22fdf34", "attempt_id": "2fdec005991b", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:57.291069Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 3}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 203, "message_tokens": 128, "message_utf8_bytes": 326, "cache_tensor_bytes": null, "serialized_payload_bytes": 326, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7147079342976213, "decode_payload_ms": 0.0, "receiver_prefill_ms": 105.24599999189377, "ttft_ms": 44.75383390672505, "decode_ms": 24.731541983783245}, "total_wall_ms": 175.54037494119257, "ttft_ms": 44.75383390672505, "input_usage": {"receiver_prompt_tokens": 203}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600736768, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6345204848, "mlx_cache_bytes": 5567824893, "process_rss_bytes": 6600736768}, "peak_prefill_memory": null, "peak_decode_memory": 6345204848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "67dd5df4b6c2cc4b5034e9623e6e48ec476f1a5f3b53d4ed80fdb39c5a099d19", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 34 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "960a53b6ffa03f96204e113b", "attempt_id": "c8f088125334", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:57.488109Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 3}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 209, "message_tokens": 128, "message_utf8_bytes": 326, "cache_tensor_bytes": null, "serialized_payload_bytes": 326, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7147079342976213, "decode_payload_ms": 0.0, "receiver_prefill_ms": 59.651290997862816, "ttft_ms": 44.325374998152256, "decode_ms": 47.68295807298273}, "total_wall_ms": 152.65408309642226, "ttft_ms": 44.325374998152256, "input_usage": {"receiver_prompt_tokens": 209}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600769536, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6350185584, "mlx_cache_bytes": 5682119677, "process_rss_bytes": 6600769536}, "peak_prefill_memory": null, "peak_decode_memory": 6350185584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "67dd5df4b6c2cc4b5034e9623e6e48ec476f1a5f3b53d4ed80fdb39c5a099d19", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 35 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "350f8498c2cc2bdba46117dc", "attempt_id": "f0eea4cdaefe", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:57.662250Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 3}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 209, "message_tokens": 128, "message_utf8_bytes": 326, "cache_tensor_bytes": null, "serialized_payload_bytes": 326, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7147079342976213, "decode_payload_ms": 0.0, "receiver_prefill_ms": 92.06504200119525, "ttft_ms": 50.073124933987856, "decode_ms": 18.201000057160854}, "total_wall_ms": 161.36324999388307, "ttft_ms": 50.073124933987856, "input_usage": {"receiver_prompt_tokens": 209}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600769536, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6350185584, "mlx_cache_bytes": 5682119677, "process_rss_bytes": 6600769536}, "peak_prefill_memory": null, "peak_decode_memory": 6350185584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "67dd5df4b6c2cc4b5034e9623e6e48ec476f1a5f3b53d4ed80fdb39c5a099d19", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 36 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "bed08623df2b233a51b643e8", "attempt_id": "019b3ff18573", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:57.845326Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 3}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 206, "message_tokens": 128, "message_utf8_bytes": 326, "cache_tensor_bytes": null, "serialized_payload_bytes": 326, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7147079342976213, "decode_payload_ms": 0.0, "receiver_prefill_ms": 125.36499998532236, "ttft_ms": 43.34979096893221, "decode_ms": 50.19183293916285}, "total_wall_ms": 219.6721249492839, "ttft_ms": 43.34979096893221, "input_usage": {"receiver_prompt_tokens": 206}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600802304, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6357738656, "mlx_cache_bytes": 5805917181, "process_rss_bytes": 6600802304}, "peak_prefill_memory": null, "peak_decode_memory": 6357738656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "67dd5df4b6c2cc4b5034e9623e6e48ec476f1a5f3b53d4ed80fdb39c5a099d19", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 37 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "da70f6f1d8274607021d1a65", "attempt_id": "aaf632e32046", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:58.086755Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 3}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 214, "message_tokens": 128, "message_utf8_bytes": 326, "cache_tensor_bytes": null, "serialized_payload_bytes": 326, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7147079342976213, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.11695798672736, "ttft_ms": 47.32775001320988, "decode_ms": 48.785457969643176}, "total_wall_ms": 179.21474995091558, "ttft_ms": 47.32775001320988, "input_usage": {"receiver_prompt_tokens": 214}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600818688, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6353364080, "mlx_cache_bytes": 5805917181, "process_rss_bytes": 6600818688}, "peak_prefill_memory": null, "peak_decode_memory": 6353364080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "67dd5df4b6c2cc4b5034e9623e6e48ec476f1a5f3b53d4ed80fdb39c5a099d19", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 38 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5a548401bf8107c962e7f07f", "attempt_id": "fad0ca1f04b2", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:58.286423Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 3}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 212, "message_tokens": 128, "message_utf8_bytes": 326, "cache_tensor_bytes": null, "serialized_payload_bytes": 326, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7147079342976213, "decode_payload_ms": 0.0, "receiver_prefill_ms": 94.01095903012902, "ttft_ms": 36.137750023044646, "decode_ms": 42.842958006076515}, "total_wall_ms": 173.7732500769198, "ttft_ms": 36.137750023044646, "input_usage": {"receiver_prompt_tokens": 212}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600835072, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6351889520, "mlx_cache_bytes": 5805917181, "process_rss_bytes": 6600835072}, "peak_prefill_memory": null, "peak_decode_memory": 6351889520, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "67dd5df4b6c2cc4b5034e9623e6e48ec476f1a5f3b53d4ed80fdb39c5a099d19", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 39 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7d6d7ceed47419bf3def92f4", "attempt_id": "4f9c9ceb94ce", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:58.480151Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 3}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 206, "message_tokens": 128, "message_utf8_bytes": 326, "cache_tensor_bytes": null, "serialized_payload_bytes": 326, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7147079342976213, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.23549998365343, "ttft_ms": 43.14154200255871, "decode_ms": 21.135332994163036}, "total_wall_ms": 147.38370792474598, "ttft_ms": 43.14154200255871, "input_usage": {"receiver_prompt_tokens": 206}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600851456, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6358295688, "mlx_cache_bytes": 5805917181, "process_rss_bytes": 6600851456}, "peak_prefill_memory": null, "peak_decode_memory": 6358295688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "67dd5df4b6c2cc4b5034e9623e6e48ec476f1a5f3b53d4ed80fdb39c5a099d19", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 40 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d649e2630c5f9f61268086dd", "attempt_id": "818276900582", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:58.649480Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 3}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 204, "message_tokens": 128, "message_utf8_bytes": 326, "cache_tensor_bytes": null, "serialized_payload_bytes": 326, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7147079342976213, "decode_payload_ms": 0.0, "receiver_prefill_ms": 91.93212504032999, "ttft_ms": 19.05783300753683, "decode_ms": 29.006875003688037}, "total_wall_ms": 140.94204199500382, "ttft_ms": 19.05783300753683, "input_usage": {"receiver_prompt_tokens": 204}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600851456, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6345729136, "mlx_cache_bytes": 5917459453, "process_rss_bytes": 6600851456}, "peak_prefill_memory": null, "peak_decode_memory": 6345729136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "67dd5df4b6c2cc4b5034e9623e6e48ec476f1a5f3b53d4ed80fdb39c5a099d19", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 41 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "77ffefdf43d830d58ed924aa", "attempt_id": "99653bbd39bb", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:58.814598Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 583, "message_tokens": 508, "message_utf8_bytes": 1231, "cache_tensor_bytes": null, "serialized_payload_bytes": 1231, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.127957995980978, "decode_payload_ms": 0.0, "receiver_prefill_ms": 155.91591701377183, "ttft_ms": 41.78220801986754, "decode_ms": 48.34500001743436}, "total_wall_ms": 247.34445801004767, "ttft_ms": 41.78220801986754, "input_usage": {"receiver_prompt_tokens": 583}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600949760, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6559592536, "mlx_cache_bytes": 6272041981, "process_rss_bytes": 6600949760}, "peak_prefill_memory": null, "peak_decode_memory": 6559592536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "386755a6041624133cae3e906274e1dbaa1ac732378d43f385e9581f5c9aba44", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 42 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d526aabbe84d0dba86056194", "attempt_id": "c7be020467cc", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:59.084813Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 589, "message_tokens": 508, "message_utf8_bytes": 1231, "cache_tensor_bytes": null, "serialized_payload_bytes": 1231, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.127957995980978, "decode_payload_ms": 0.0, "receiver_prefill_ms": 202.24424998741597, "ttft_ms": 51.58279195893556, "decode_ms": 46.79262498393655}, "total_wall_ms": 301.9260410219431, "ttft_ms": 51.58279195893556, "input_usage": {"receiver_prompt_tokens": 589}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6601015296, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6563131480, "mlx_cache_bytes": 6615417853, "process_rss_bytes": 6601015296}, "peak_prefill_memory": null, "peak_decode_memory": 6563131480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "386755a6041624133cae3e906274e1dbaa1ac732378d43f385e9581f5c9aba44", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 43 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2bebbc559d57148a86a9913b", "attempt_id": "bac7cc0fe14f", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:59.407181Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 589, "message_tokens": 508, "message_utf8_bytes": 1231, "cache_tensor_bytes": null, "serialized_payload_bytes": 1231, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.127957995980978, "decode_payload_ms": 0.0, "receiver_prefill_ms": 148.44395802356303, "ttft_ms": 42.530416045337915, "decode_ms": 378.4955000737682}, "total_wall_ms": 570.7270840648562, "ttft_ms": 42.530416045337915, "input_usage": {"receiver_prompt_tokens": 589}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6601031680, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6563131480, "mlx_cache_bytes": 6615417853, "process_rss_bytes": 6601031680}, "peak_prefill_memory": null, "peak_decode_memory": 6563131480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,068,030", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "386755a6041624133cae3e906274e1dbaa1ac732378d43f385e9581f5c9aba44", "output_hash": "d1643b9a5cdbde943cffa17e0bd2ea3a63bd11939d2b80e5c53fe3f1d39a8e26"} | |
| 44 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5ba4373fd5c1c6bf514fb3a7", "attempt_id": "b84710e9686f", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:49:59.998287Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 586, "message_tokens": 508, "message_utf8_bytes": 1231, "cache_tensor_bytes": null, "serialized_payload_bytes": 1231, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.127957995980978, "decode_payload_ms": 0.0, "receiver_prefill_ms": 146.26754098571837, "ttft_ms": 21.77520899567753, "decode_ms": 183.84687509387732}, "total_wall_ms": 353.2489159842953, "ttft_ms": 21.77520899567753, "input_usage": {"receiver_prompt_tokens": 586}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 6601048064, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6561951832, "mlx_cache_bytes": 6856459261, "process_rss_bytes": 6601048064}, "peak_prefill_memory": null, "peak_decode_memory": 6561951832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "386755a6041624133cae3e906274e1dbaa1ac732378d43f385e9581f5c9aba44", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 45 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "284d5c9a6da9e1176c093723", "attempt_id": "35eb8851efc9", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:00.374341Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 594, "message_tokens": 508, "message_utf8_bytes": 1231, "cache_tensor_bytes": null, "serialized_payload_bytes": 1231, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.127957995980978, "decode_payload_ms": 0.0, "receiver_prefill_ms": 173.6891670152545, "ttft_ms": 43.01970906089991, "decode_ms": 325.49429091159254}, "total_wall_ms": 543.6962500680238, "ttft_ms": 43.01970906089991, "input_usage": {"receiver_prompt_tokens": 594}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6601080832, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6566572120, "mlx_cache_bytes": 7013155837, "process_rss_bytes": 6601080832}, "peak_prefill_memory": null, "peak_decode_memory": 6566572120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "386755a6041624133cae3e906274e1dbaa1ac732378d43f385e9581f5c9aba44", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 46 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "745fe7f5792c4ff45fbe1259", "attempt_id": "f0fef70ba26a", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:00.939653Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 592, "message_tokens": 508, "message_utf8_bytes": 1231, "cache_tensor_bytes": null, "serialized_payload_bytes": 1231, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.127957995980978, "decode_payload_ms": 0.0, "receiver_prefill_ms": 177.32991697266698, "ttft_ms": 51.515334052965045, "decode_ms": 48.80475008394569}, "total_wall_ms": 278.98929093498737, "ttft_ms": 51.515334052965045, "input_usage": {"receiver_prompt_tokens": 592}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600949760, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6585167960, "mlx_cache_bytes": 7278478333, "process_rss_bytes": 6600949760}, "peak_prefill_memory": null, "peak_decode_memory": 6585167960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "386755a6041624133cae3e906274e1dbaa1ac732378d43f385e9581f5c9aba44", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 47 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1b5f86671906a5ce0e014cdc", "attempt_id": "b5e707987966", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:01.239542Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 586, "message_tokens": 508, "message_utf8_bytes": 1231, "cache_tensor_bytes": null, "serialized_payload_bytes": 1231, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.127957995980978, "decode_payload_ms": 0.0, "receiver_prefill_ms": 201.5844159759581, "ttft_ms": 31.360000022687018, "decode_ms": 23.63358298316598}, "total_wall_ms": 257.8552080085501, "ttft_ms": 31.360000022687018, "input_usage": {"receiver_prompt_tokens": 586}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600982528, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6561951832, "mlx_cache_bytes": 7278478333, "process_rss_bytes": 6600982528}, "peak_prefill_memory": null, "peak_decode_memory": 6561951832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "386755a6041624133cae3e906274e1dbaa1ac732378d43f385e9581f5c9aba44", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 48 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f4753707bacf518cec2c7e8b", "attempt_id": "ab1f2bd44b6c", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:01.517818Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 584, "message_tokens": 508, "message_utf8_bytes": 1231, "cache_tensor_bytes": null, "serialized_payload_bytes": 1231, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.127957995980978, "decode_payload_ms": 0.0, "receiver_prefill_ms": 190.75366598553956, "ttft_ms": 39.51524989679456, "decode_ms": 43.95299998577684}, "total_wall_ms": 275.4939589649439, "ttft_ms": 39.51524989679456, "input_usage": {"receiver_prompt_tokens": 584}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600998912, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6559985752, "mlx_cache_bytes": 7518635005, "process_rss_bytes": 6600998912}, "peak_prefill_memory": null, "peak_decode_memory": 6559985752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "386755a6041624133cae3e906274e1dbaa1ac732378d43f385e9581f5c9aba44", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 49 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ff503f4991b69d71a9cbbcd9", "attempt_id": "cd5a0a253b31", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:01.815582Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 24}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 587, "message_tokens": 512, "message_utf8_bytes": 1358, "cache_tensor_bytes": null, "serialized_payload_bytes": 1358, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.1087090242654085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 182.11904203053564, "ttft_ms": 42.147999978624284, "decode_ms": 335.11224994435906}, "total_wall_ms": 561.8233749410138, "ttft_ms": 42.147999978624284, "input_usage": {"receiver_prompt_tokens": 587}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 6600835072, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6562246744, "mlx_cache_bytes": 7759971325, "process_rss_bytes": 6600835072}, "peak_prefill_memory": null, "peak_decode_memory": 6562246744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9c6f1d7683c25b99905915cd50af46f8624d0e046d60064afa1f8536d2053414", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 50 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "cfed9f490577aa19cffef409", "attempt_id": "aad1d7b7f79b", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:02.398863Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 25}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 589, "message_tokens": 508, "message_utf8_bytes": 1477, "cache_tensor_bytes": null, "serialized_payload_bytes": 1477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.0590419406071305, "decode_payload_ms": 0.0, "receiver_prefill_ms": 175.15408399049193, "ttft_ms": 46.27291695214808, "decode_ms": 337.7104999963194}, "total_wall_ms": 561.484833015129, "ttft_ms": 46.27291695214808, "input_usage": {"receiver_prompt_tokens": 589}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6600835072, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6563131480, "mlx_cache_bytes": 7759971325, "process_rss_bytes": 6600835072}, "peak_prefill_memory": null, "peak_decode_memory": 6563131480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0c282c4bd4288101fb9f0b7c3f7960301f9b9cae0e1b006f3d55fa33cb6c3bdc", "output_hash": "b6582a041b3d2b38ac6924099568ca2e6f1a610c6fb5f4de2e0516b90433bc2a"} | |
| 51 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e7d124b13680912c2a334bab", "attempt_id": "561ac6b167af", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:02.981197Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 499, "n_sentences": 24}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 580, "message_tokens": 499, "message_utf8_bytes": 1320, "cache_tensor_bytes": null, "serialized_payload_bytes": 1320, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.0496670147404075, "decode_payload_ms": 0.0, "receiver_prefill_ms": 167.33445797581226, "ttft_ms": 38.87175000272691, "decode_ms": 289.80229201260954}, "total_wall_ms": 498.2860420132056, "ttft_ms": 38.87175000272691, "input_usage": {"receiver_prompt_tokens": 580}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 6600835072, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6577401944, "mlx_cache_bytes": 8019936253, "process_rss_bytes": 6600835072}, "peak_prefill_memory": null, "peak_decode_memory": 6577401944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "77c2c83f97318ad674e337c84e8706903022a99e330a15111b84b24346998e7c", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 52 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "27baf0f22614de8b3768ca95", "attempt_id": "9e8d3021295e", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:03.500827Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 499, "n_sentences": 17}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 577, "message_tokens": 499, "message_utf8_bytes": 1439, "cache_tensor_bytes": null, "serialized_payload_bytes": 1439, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.9218748891726136, "decode_payload_ms": 0.0, "receiver_prefill_ms": 148.2660420006141, "ttft_ms": 52.42104199714959, "decode_ms": 207.91524997912347}, "total_wall_ms": 410.8636670280248, "ttft_ms": 52.42104199714959, "input_usage": {"receiver_prompt_tokens": 577}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 6600949760, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6555218008, "mlx_cache_bytes": 8334902269, "process_rss_bytes": 6600949760}, "peak_prefill_memory": null, "peak_decode_memory": 6555218008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "8c78c2c57027b9340eda90e83f732ddd57af36c5177bd2241b5f21f5452cfb30", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 53 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2fe05c9027e879b87d76e4cd", "attempt_id": "834114cbda04", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:03.932833Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 14}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 597, "message_tokens": 511, "message_utf8_bytes": 1212, "cache_tensor_bytes": null, "serialized_payload_bytes": 1212, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.136208069510758, "decode_payload_ms": 0.0, "receiver_prefill_ms": 209.54304095357656, "ttft_ms": 48.278250033035874, "decode_ms": 325.0983749749139}, "total_wall_ms": 585.3710420196876, "ttft_ms": 48.278250033035874, "input_usage": {"receiver_prompt_tokens": 597}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6600949760, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6567653464, "mlx_cache_bytes": 8580269053, "process_rss_bytes": 6600949760}, "peak_prefill_memory": null, "peak_decode_memory": 6567653464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b1b71eb7de8b1ef4eb5d401effd828bab160a4a00b6b0c9c62db233a9dc6cdf7", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 54 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "bc2675868d450a10dfb9c39e", "attempt_id": "f70e965119b1", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:04.541246Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 26}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 591, "message_tokens": 507, "message_utf8_bytes": 1431, "cache_tensor_bytes": null, "serialized_payload_bytes": 1431, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.1420410592108965, "decode_payload_ms": 0.0, "receiver_prefill_ms": 189.75595792289823, "ttft_ms": 43.90158294700086, "decode_ms": 364.7835840238258}, "total_wall_ms": 601.0728749679402, "ttft_ms": 43.90158294700086, "input_usage": {"receiver_prompt_tokens": 591}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 6600966144, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6582136920, "mlx_cache_bytes": 8823178237, "process_rss_bytes": 6600966144}, "peak_prefill_memory": null, "peak_decode_memory": 6582136920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SP-38G-4217", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e7c991ceabb14f3dd74de0b7f83992695d4c4b66708e36722b855d130f504f94", "output_hash": "e643c21a78559b96fd65325d9ce779b7b8fd6a47c53cf7c2cda1efa8412458c4"} | |
| 55 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f70e52e5a1e040bfbf73181e", "attempt_id": "bee678b24cf4", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:05.164538Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 509, "n_sentences": 22}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 587, "message_tokens": 509, "message_utf8_bytes": 1514, "cache_tensor_bytes": null, "serialized_payload_bytes": 1514, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.2312920298427343, "decode_payload_ms": 0.0, "receiver_prefill_ms": 195.89691690634936, "ttft_ms": 37.64795802999288, "decode_ms": 43.63908397499472}, "total_wall_ms": 279.62329098954797, "ttft_ms": 37.64795802999288, "input_usage": {"receiver_prompt_tokens": 587}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600982528, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6562246744, "mlx_cache_bytes": 8823178237, "process_rss_bytes": 6600982528}, "peak_prefill_memory": null, "peak_decode_memory": 6562246744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b968cdd6fcc361d0982c0da716336ce5ade8e57a2374e310262166750a963a0d", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 56 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6b2c79c4c442a62acfc8e721", "attempt_id": "884ca4710385", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:05.465061Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 22}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 586, "message_tokens": 510, "message_utf8_bytes": 1513, "cache_tensor_bytes": null, "serialized_payload_bytes": 1513, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.013041939586401, "decode_payload_ms": 0.0, "receiver_prefill_ms": 189.1854169080034, "ttft_ms": 18.651874968782067, "decode_ms": 26.465042028576136}, "total_wall_ms": 236.82258394546807, "ttft_ms": 18.651874968782067, "input_usage": {"receiver_prompt_tokens": 586}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600982528, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6561951832, "mlx_cache_bytes": 8823178237, "process_rss_bytes": 6600982528}, "peak_prefill_memory": null, "peak_decode_memory": 6561951832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f6abba20464ca36454f355f0746779b994274921acba0d41c40660a00845ed1f", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 57 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "bd50c544969cd0b73594684f", "attempt_id": "d1525a6dc027", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:11.080862Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 207, "message_tokens": 128, "message_utf8_bytes": 288, "cache_tensor_bytes": null, "serialized_payload_bytes": 288, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5357.089624973014, "decode_payload_ms": 0.0, "receiver_prefill_ms": 86.47970808669925, "ttft_ms": 34.69141595996916, "decode_ms": 33.22983405087143}, "total_wall_ms": 155.22262500599027, "ttft_ms": 34.69141595996916, "input_usage": {"receiver_prompt_tokens": 207, "sender_input_tokens": 2086, "sender_output_tokens": 128, "sender_prefill_ms": 572.2841250244528, "sender_ttft_ms": 43.00425003748387, "sender_decode_ms": 4739.774457993917}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6601244672, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6358688904, "mlx_cache_bytes": 8943502333, "process_rss_bytes": 6601244672}, "peak_prefill_memory": null, "peak_decode_memory": 6358688904, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c1f5c1b08a795ed7110a28f89139d5d4e36268379c8be60bcb7449d0cf723f13", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 58 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "001c12267a45fe00a59db1be", "attempt_id": "9d31cda253e9", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:11.259070Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 213, "message_tokens": 128, "message_utf8_bytes": 288, "cache_tensor_bytes": null, "serialized_payload_bytes": 288, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5357.089624973014, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.06029098760337, "ttft_ms": 46.73562501557171, "decode_ms": 37.23804093897343}, "total_wall_ms": 164.89437501877546, "ttft_ms": 46.73562501557171, "input_usage": {"receiver_prompt_tokens": 213, "sender_input_tokens": 2086, "sender_output_tokens": 128, "sender_prefill_ms": 572.2841250244528, "sender_ttft_ms": 43.00425003748387, "sender_decode_ms": 4739.774457993917}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6601244672, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6351725680, "mlx_cache_bytes": 9059894269, "process_rss_bytes": 6601244672}, "peak_prefill_memory": null, "peak_decode_memory": 6351725680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c1f5c1b08a795ed7110a28f89139d5d4e36268379c8be60bcb7449d0cf723f13", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 59 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "807e4cc7994c09447b603950", "attempt_id": "a9ad279d120b", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:11.443689Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 213, "message_tokens": 128, "message_utf8_bytes": 288, "cache_tensor_bytes": null, "serialized_payload_bytes": 288, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5357.089624973014, "decode_payload_ms": 0.0, "receiver_prefill_ms": 88.87387509457767, "ttft_ms": 46.50487506296486, "decode_ms": 22.77625002898276}, "total_wall_ms": 158.9888749876991, "ttft_ms": 46.50487506296486, "input_usage": {"receiver_prompt_tokens": 213, "sender_input_tokens": 2086, "sender_output_tokens": 128, "sender_prefill_ms": 572.2841250244528, "sender_ttft_ms": 43.00425003748387, "sender_decode_ms": 4739.774457993917}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6601244672, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6351725680, "mlx_cache_bytes": 9059894269, "process_rss_bytes": 6601244672}, "peak_prefill_memory": null, "peak_decode_memory": 6351725680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c1f5c1b08a795ed7110a28f89139d5d4e36268379c8be60bcb7449d0cf723f13", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 60 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2d5b038eadcfcb192be47771", "attempt_id": "f7131dbeb50b", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:11.623283Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 210, "message_tokens": 128, "message_utf8_bytes": 288, "cache_tensor_bytes": null, "serialized_payload_bytes": 288, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5357.089624973014, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.21091699972749, "ttft_ms": 43.99662499781698, "decode_ms": 42.46820800472051}, "total_wall_ms": 166.74104100093246, "ttft_ms": 43.99662499781698, "input_usage": {"receiver_prompt_tokens": 210, "sender_input_tokens": 2086, "sender_output_tokens": 128, "sender_prefill_ms": 572.2841250244528, "sender_ttft_ms": 43.00425003748387, "sender_decode_ms": 4739.774457993917}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6601261056, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6350840944, "mlx_cache_bytes": 9133556733, "process_rss_bytes": 6601261056}, "peak_prefill_memory": null, "peak_decode_memory": 6350840944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c1f5c1b08a795ed7110a28f89139d5d4e36268379c8be60bcb7449d0cf723f13", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 61 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4e587557a9581e25d551c063", "attempt_id": "f682d9d14e23", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:11.811245Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 218, "message_tokens": 128, "message_utf8_bytes": 288, "cache_tensor_bytes": null, "serialized_payload_bytes": 288, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5357.089624973014, "decode_payload_ms": 0.0, "receiver_prefill_ms": 87.74291700683534, "ttft_ms": 33.67295803036541, "decode_ms": 356.4188750460744}, "total_wall_ms": 478.7968749878928, "ttft_ms": 33.67295803036541, "input_usage": {"receiver_prompt_tokens": 218, "sender_input_tokens": 2086, "sender_output_tokens": 128, "sender_prefill_ms": 572.2841250244528, "sender_ttft_ms": 43.00425003748387, "sender_decode_ms": 4739.774457993917}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6601277440, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6367814792, "mlx_cache_bytes": 9252832253, "process_rss_bytes": 6601277440}, "peak_prefill_memory": null, "peak_decode_memory": 6367814792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c1f5c1b08a795ed7110a28f89139d5d4e36268379c8be60bcb7449d0cf723f13", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 62 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6ce8dab9103c1c633ee0ad19", "attempt_id": "1b0314a4665c", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:12.311221Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 216, "message_tokens": 128, "message_utf8_bytes": 288, "cache_tensor_bytes": null, "serialized_payload_bytes": 288, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5357.089624973014, "decode_payload_ms": 0.0, "receiver_prefill_ms": 83.17016693763435, "ttft_ms": 56.20595801156014, "decode_ms": 31.98158403392881}, "total_wall_ms": 172.2495419671759, "ttft_ms": 56.20595801156014, "input_usage": {"receiver_prompt_tokens": 216, "sender_input_tokens": 2086, "sender_output_tokens": 128, "sender_prefill_ms": 572.2841250244528, "sender_ttft_ms": 43.00425003748387, "sender_decode_ms": 4739.774457993917}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6601293824, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6354412656, "mlx_cache_bytes": 9328591869, "process_rss_bytes": 6601293824}, "peak_prefill_memory": null, "peak_decode_memory": 6354412656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c1f5c1b08a795ed7110a28f89139d5d4e36268379c8be60bcb7449d0cf723f13", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 63 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "03f25a96c38315f546ef3f7a", "attempt_id": "8426d55df1d3", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:12.505465Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 210, "message_tokens": 128, "message_utf8_bytes": 288, "cache_tensor_bytes": null, "serialized_payload_bytes": 288, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5357.089624973014, "decode_payload_ms": 0.0, "receiver_prefill_ms": 94.84495909418911, "ttft_ms": 33.99795794393867, "decode_ms": 38.60362502746284}, "total_wall_ms": 168.34004106931388, "ttft_ms": 33.99795794393867, "input_usage": {"receiver_prompt_tokens": 210, "sender_input_tokens": 2086, "sender_output_tokens": 128, "sender_prefill_ms": 572.2841250244528, "sender_ttft_ms": 43.00425003748387, "sender_decode_ms": 4739.774457993917}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6601293824, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6350840944, "mlx_cache_bytes": 9328591869, "process_rss_bytes": 6601293824}, "peak_prefill_memory": null, "peak_decode_memory": 6350840944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c1f5c1b08a795ed7110a28f89139d5d4e36268379c8be60bcb7449d0cf723f13", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 64 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d87ff6d5b0d9bcceffbffbbc", "attempt_id": "076dcc0c99b3", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:12.695828Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 208, "message_tokens": 128, "message_utf8_bytes": 288, "cache_tensor_bytes": null, "serialized_payload_bytes": 288, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5357.089624973014, "decode_payload_ms": 0.0, "receiver_prefill_ms": 84.99754196964204, "ttft_ms": 19.704332924447954, "decode_ms": 37.26479201577604}, "total_wall_ms": 142.82641594763845, "ttft_ms": 19.704332924447954, "input_usage": {"receiver_prompt_tokens": 208, "sender_input_tokens": 2086, "sender_output_tokens": 128, "sender_prefill_ms": 572.2841250244528, "sender_ttft_ms": 43.00425003748387, "sender_decode_ms": 4739.774457993917}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6601293824, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6359868552, "mlx_cache_bytes": 9328591869, "process_rss_bytes": 6601293824}, "peak_prefill_memory": null, "peak_decode_memory": 6359868552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c1f5c1b08a795ed7110a28f89139d5d4e36268379c8be60bcb7449d0cf723f13", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 65 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "60db059748d0a3b05967b502", "attempt_id": "828ee0224cea", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:33.128851Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20267.59104197845, "decode_payload_ms": 0.0, "receiver_prefill_ms": 203.14004202373326, "ttft_ms": 28.74737500678748, "decode_ms": 394.19945899862796}, "total_wall_ms": 627.724124933593, "ttft_ms": 28.74737500678748, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 2087, "sender_output_tokens": 512, "sender_prefill_ms": 548.8623749697581, "sender_ttft_ms": 49.25675003323704, "sender_decode_ms": 19667.46804106515}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 6601375744, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6582136920, "mlx_cache_bytes": 9500820477, "process_rss_bytes": 6601375744}, "peak_prefill_memory": null, "peak_decode_memory": 6582136920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 66 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "b0b0c81f969c1736283bcfe7", "attempt_id": "9bb1b19b0b3d", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:33.783215Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 597, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20267.59104197845, "decode_payload_ms": 0.0, "receiver_prefill_ms": 183.51595802232623, "ttft_ms": 19.946582964621484, "decode_ms": 41.30941699258983}, "total_wall_ms": 246.46916706115007, "ttft_ms": 19.946582964621484, "input_usage": {"receiver_prompt_tokens": 597, "sender_input_tokens": 2087, "sender_output_tokens": 512, "sender_prefill_ms": 548.8623749697581, "sender_ttft_ms": 49.25675003323704, "sender_decode_ms": 19667.46804106515}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6601375744, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6567653464, "mlx_cache_bytes": 9500820477, "process_rss_bytes": 6601375744}, "peak_prefill_memory": null, "peak_decode_memory": 6567653464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 67 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "99de6273c9600fddb438f1d7", "attempt_id": "2c4fe8796cf3", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:34.054357Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 597, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20267.59104197845, "decode_payload_ms": 0.0, "receiver_prefill_ms": 232.18620801344514, "ttft_ms": 30.138583038933575, "decode_ms": 33.883374999277294}, "total_wall_ms": 297.7294169832021, "ttft_ms": 30.138583038933575, "input_usage": {"receiver_prompt_tokens": 597, "sender_input_tokens": 2087, "sender_output_tokens": 512, "sender_prefill_ms": 548.8623749697581, "sender_ttft_ms": 49.25675003323704, "sender_decode_ms": 19667.46804106515}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6601375744, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6567653464, "mlx_cache_bytes": 9500820477, "process_rss_bytes": 6601375744}, "peak_prefill_memory": null, "peak_decode_memory": 6567653464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 68 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "972b2521690d285b8bc67c21", "attempt_id": "df2e83a51555", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:34.374794Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20267.59104197845, "decode_payload_ms": 0.0, "receiver_prefill_ms": 224.3669159943238, "ttft_ms": 22.97604107297957, "decode_ms": 17.95237499754876}, "total_wall_ms": 266.74049999564886, "ttft_ms": 22.97604107297957, "input_usage": {"receiver_prompt_tokens": 594, "sender_input_tokens": 2087, "sender_output_tokens": 512, "sender_prefill_ms": 548.8623749697581, "sender_ttft_ms": 49.25675003323704, "sender_decode_ms": 19667.46804106515}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6601375744, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6566572120, "mlx_cache_bytes": 9500820477, "process_rss_bytes": 6601375744}, "peak_prefill_memory": null, "peak_decode_memory": 6566572120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 69 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "00febe37781016a142d26964", "attempt_id": "65ea1c5d1d91", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:34.664475Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20267.59104197845, "decode_payload_ms": 0.0, "receiver_prefill_ms": 207.15975004713982, "ttft_ms": 46.175166964530945, "decode_ms": 368.2772920001298}, "total_wall_ms": 623.0741670588031, "ttft_ms": 46.175166964530945, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 2087, "sender_output_tokens": 512, "sender_prefill_ms": 548.8623749697581, "sender_ttft_ms": 49.25675003323704, "sender_decode_ms": 19667.46804106515}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6601408512, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6581891160, "mlx_cache_bytes": 9748349949, "process_rss_bytes": 6601408512}, "peak_prefill_memory": null, "peak_decode_memory": 6581891160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 70 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "85de3682876a5ad12924390a", "attempt_id": "2de5beb86693", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:35.311618Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20267.59104197845, "decode_payload_ms": 0.0, "receiver_prefill_ms": 165.15562497079372, "ttft_ms": 48.18745795637369, "decode_ms": 388.31354200374335}, "total_wall_ms": 603.0747499316931, "ttft_ms": 48.18745795637369, "input_usage": {"receiver_prompt_tokens": 600, "sender_input_tokens": 2087, "sender_output_tokens": 512, "sender_prefill_ms": 548.8623749697581, "sender_ttft_ms": 49.25675003323704, "sender_decode_ms": 19667.46804106515}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 6601408512, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6567260248, "mlx_cache_bytes": 9906619389, "process_rss_bytes": 6601408512}, "peak_prefill_memory": null, "peak_decode_memory": 6567260248, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SP-38G-4217", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "e643c21a78559b96fd65325d9ce779b7b8fd6a47c53cf7c2cda1efa8412458c4"} | |
| 71 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "040faea8dc90b744a248bfbb", "attempt_id": "89c386e78ead", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:35.937650Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20267.59104197845, "decode_payload_ms": 0.0, "receiver_prefill_ms": 150.53695801179856, "ttft_ms": 26.867000036872923, "decode_ms": 31.897875014692545}, "total_wall_ms": 210.681667085737, "ttft_ms": 26.867000036872923, "input_usage": {"receiver_prompt_tokens": 594, "sender_input_tokens": 2087, "sender_output_tokens": 512, "sender_prefill_ms": 548.8623749697581, "sender_ttft_ms": 49.25675003323704, "sender_decode_ms": 19667.46804106515}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6601408512, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6566572120, "mlx_cache_bytes": 9906619389, "process_rss_bytes": 6601408512}, "peak_prefill_memory": null, "peak_decode_memory": 6566572120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 72 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9a38432c6d073693cc7abcef", "attempt_id": "d3eb20e34a83", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:36.170131Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20267.59104197845, "decode_payload_ms": 0.0, "receiver_prefill_ms": 193.10900010168552, "ttft_ms": 48.168833018280566, "decode_ms": 30.483458074741066}, "total_wall_ms": 273.1704580364749, "ttft_ms": 48.168833018280566, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 2087, "sender_output_tokens": 512, "sender_prefill_ms": 548.8623749697581, "sender_ttft_ms": 49.25675003323704, "sender_decode_ms": 19667.46804106515}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6601408512, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6582726744, "mlx_cache_bytes": 9906619389, "process_rss_bytes": 6601408512}, "peak_prefill_memory": null, "peak_decode_memory": 6582726744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 73 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c5d80addd1f25a970ef70a60", "attempt_id": "dc60effed0dc", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:36.467592Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 121, "message_tokens": 43, "message_utf8_bytes": 168, "cache_tensor_bytes": null, "serialized_payload_bytes": 168, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2326.683791936375, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.99925003480166, "ttft_ms": 30.39112500846386, "decode_ms": 423.52000006940216}, "total_wall_ms": 2837.184499949217, "ttft_ms": 30.39112500846386, "input_usage": {"receiver_prompt_tokens": 121, "sender_input_tokens": 2082, "sender_output_tokens": 43, "sender_prefill_ms": 575.4174999892712, "sender_ttft_ms": 41.759541956707835, "sender_decode_ms": 1707.3157080449164}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 6558646272, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6278603376, "mlx_cache_bytes": 10015048701, "process_rss_bytes": 6558646272}, "peak_prefill_memory": null, "peak_decode_memory": 6278603376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "67918d4922cc4a215f8af73fc75418b9db0043e809df8ec4e58e84d6f417633c", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 74 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "059c1e317cf8f7f98d662f51", "attempt_id": "f29c392371ba", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:39.328730Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 170, "message_tokens": 86, "message_utf8_bytes": 269, "cache_tensor_bytes": null, "serialized_payload_bytes": 269, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3948.0282498989254, "decode_payload_ms": 0.0, "receiver_prefill_ms": 85.46241594012827, "ttft_ms": 47.27683402597904, "decode_ms": 281.0025420039892}, "total_wall_ms": 4362.543457886204, "ttft_ms": 47.27683402597904, "input_usage": {"receiver_prompt_tokens": 170, "sender_input_tokens": 2088, "sender_output_tokens": 86, "sender_prefill_ms": 572.1418749308214, "sender_ttft_ms": 46.04549997020513, "sender_decode_ms": 3327.9037920292467}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6558760960, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6319449200, "mlx_cache_bytes": 10154214397, "process_rss_bytes": 6558760960}, "peak_prefill_memory": null, "peak_decode_memory": 6319449200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "13f8fdf17734f24bbe35b808c94ee3e08ab82732e7aec7db49c33a3a0353ffc4", "output_hash": "b6582a041b3d2b38ac6924099568ca2e6f1a610c6fb5f4de2e0516b90433bc2a"} | |
| 75 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "28463ed003820e507349b8ea", "attempt_id": "fe605ec1b8e3", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:43.712225Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 120, "message_tokens": 36, "message_utf8_bytes": 120, "cache_tensor_bytes": null, "serialized_payload_bytes": 120, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2028.6041660001501, "decode_payload_ms": 0.0, "receiver_prefill_ms": 65.41991699486971, "ttft_ms": 52.16733308043331, "decode_ms": 280.0687920534983}, "total_wall_ms": 2426.891708979383, "ttft_ms": 52.16733308043331, "input_usage": {"receiver_prompt_tokens": 120, "sender_input_tokens": 2088, "sender_output_tokens": 36, "sender_prefill_ms": 611.6607079748064, "sender_ttft_ms": 39.29641598369926, "sender_decode_ms": 1375.6340839900076}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 6558777344, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6278079088, "mlx_cache_bytes": 10196157437, "process_rss_bytes": 6558777344}, "peak_prefill_memory": null, "peak_decode_memory": 6278079088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "69f0de825fd0240070d8315da99518a3de438de80cf7ebf353b4ba57798fb79d", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 76 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "cae7610011d07e2d4ed7f376", "attempt_id": "d7ccedc639a2", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:46.160460Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 155, "message_tokens": 74, "message_utf8_bytes": 236, "cache_tensor_bytes": null, "serialized_payload_bytes": 236, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3465.2858750196174, "decode_payload_ms": 0.0, "receiver_prefill_ms": 108.12795802485198, "ttft_ms": 44.621291919611394, "decode_ms": 108.44966606236994}, "total_wall_ms": 3727.6338329538703, "ttft_ms": 44.621291919611394, "input_usage": {"receiver_prompt_tokens": 155, "sender_input_tokens": 2085, "sender_output_tokens": 74, "sender_prefill_ms": 554.2692090384662, "sender_ttft_ms": 41.221374995075166, "sender_decode_ms": 2867.85387492273}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 6557892608, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6306620528, "mlx_cache_bytes": 10334454781, "process_rss_bytes": 6557892608}, "peak_prefill_memory": null, "peak_decode_memory": 6306620528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "6870ea9f2332f5028ea3bd157a4cd79185e0c56d7dbdff6c6d165d96ab97ec94", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 77 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e52c34ec69177456ba83f79b", "attempt_id": "b2394cae2d4a", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:49.909430Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 251, "message_tokens": 162, "message_utf8_bytes": 521, "cache_tensor_bytes": null, "serialized_payload_bytes": 521, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 6819.481833954342, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.50120905600488, "ttft_ms": 42.372124968096614, "decode_ms": 302.0131249213591}, "total_wall_ms": 7241.7372920317575, "ttft_ms": 42.372124968096614, "input_usage": {"receiver_prompt_tokens": 251, "sender_input_tokens": 2093, "sender_output_tokens": 162, "sender_prefill_ms": 707.0347499102354, "sender_ttft_ms": 52.32829204760492, "sender_decode_ms": 6057.84904200118}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 6388383744, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6397617264, "mlx_cache_bytes": 10505012221, "process_rss_bytes": 6388383744}, "peak_prefill_memory": null, "peak_decode_memory": 6397617264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6889172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3463b753dd8829ea6fec059b9cd58dcc1a7c02bf15c4fad6b7612262255b579b", "output_hash": "adcb8d196080006451756ad2fe2106d5a1b6500c0f76ffaa05d7fe704243ad3b"} | |
| 78 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8bcead4a1aaf963ae9e946bc", "attempt_id": "00e556a7cd42", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:50:57.176355Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 147, "message_tokens": 60, "message_utf8_bytes": 240, "cache_tensor_bytes": null, "serialized_payload_bytes": 240, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2926.3977089431137, "decode_payload_ms": 0.0, "receiver_prefill_ms": 41.571542038582265, "ttft_ms": 28.354624984785914, "decode_ms": 413.99049991741776}, "total_wall_ms": 3411.1245409585536, "ttft_ms": 28.354624984785914, "input_usage": {"receiver_prompt_tokens": 147, "sender_input_tokens": 2091, "sender_output_tokens": 60, "sender_prefill_ms": 583.3549579838291, "sender_ttft_ms": 48.79212495870888, "sender_decode_ms": 2292.3897500149906}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 6388662272, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6300279920, "mlx_cache_bytes": 10636116989, "process_rss_bytes": 6388662272}, "peak_prefill_memory": null, "peak_decode_memory": 6300279920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SP-38G-4217", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "bf25cc6aed1c6ade7cbaeeb4a635af6e9dec714e42a0a6e9bea2ffd1887bdac9", "output_hash": "e643c21a78559b96fd65325d9ce779b7b8fd6a47c53cf7c2cda1efa8412458c4"} | |
| 79 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ef0ae0c957bbe5f7f9be4455", "attempt_id": "9a7a6d5e58cf", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:00.607423Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 242, "message_tokens": 161, "message_utf8_bytes": 428, "cache_tensor_bytes": null, "serialized_payload_bytes": 428, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 6918.077458045445, "decode_payload_ms": 0.0, "receiver_prefill_ms": 84.76508292369545, "ttft_ms": 42.02079097740352, "decode_ms": 36.63241700269282}, "total_wall_ms": 7082.401582971215, "ttft_ms": 42.02079097740352, "input_usage": {"receiver_prompt_tokens": 242, "sender_input_tokens": 2085, "sender_output_tokens": 161, "sender_prefill_ms": 644.1854999866337, "sender_ttft_ms": 47.369541018269956, "sender_decode_ms": 6224.478416959755}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6389055488, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6375466096, "mlx_cache_bytes": 10782000125, "process_rss_bytes": 6389055488}, "peak_prefill_memory": null, "peak_decode_memory": 6375466096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "4fd85a20e1dae1cfd12c1496aa35c7f6b9f63ec4f9e3954d6e8325f8a4da5f4d", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 80 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0ffcfc752a12e13bd6f61512", "attempt_id": "945fdb624ecd", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:07.708882Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 181, "message_tokens": 102, "message_utf8_bytes": 340, "cache_tensor_bytes": null, "serialized_payload_bytes": 340, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4510.75499993749, "decode_payload_ms": 0.0, "receiver_prefill_ms": 97.02654206193984, "ttft_ms": 33.74350001104176, "decode_ms": 34.6085000783205}, "total_wall_ms": 4677.098875050433, "ttft_ms": 33.74350001104176, "input_usage": {"receiver_prompt_tokens": 181, "sender_input_tokens": 2083, "sender_output_tokens": 102, "sender_prefill_ms": 567.8197500528768, "sender_ttft_ms": 36.7324169492349, "sender_decode_ms": 3904.24854203593}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6388269056, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6327739504, "mlx_cache_bytes": 10909139965, "process_rss_bytes": 6388269056}, "peak_prefill_memory": null, "peak_decode_memory": 6327739504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3b75210dd375ba950bf4b73febd17778e61945603a415dc22d9590c42b1773b0", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 81 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8701c581dbc14f5227d24a15", "attempt_id": "3f8040a810ad", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:18.234519Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 137, "message_tokens": 47, "message_utf8_bytes": 113, "cache_tensor_bytes": null, "serialized_payload_bytes": 113, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5828.520458075218, "decode_payload_ms": 0.0, "receiver_prefill_ms": 152.1300420863554, "ttft_ms": 66.38229195959866, "decode_ms": 65.39833301212639}, "total_wall_ms": 285.24745802860707, "ttft_ms": 66.38229195959866, "input_usage": {"receiver_prompt_tokens": 137, "sender_input_tokens": 2115, "sender_output_tokens": 128, "sender_prefill_ms": 753.3047500764951, "sender_ttft_ms": 46.19274998549372, "sender_decode_ms": 5025.524459080771}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6284525568, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6291530864, "mlx_cache_bytes": 11015046141, "process_rss_bytes": 6284525568}, "peak_prefill_memory": null, "peak_decode_memory": 6291530864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2e2e9d8372d61bc2abf4d92635ab8105eb20a4de648105008806bc2d8f7c4d96", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 82 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4332bd474814fd60a1da05ed", "attempt_id": "366bf77ee951", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:18.543040Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 143, "message_tokens": 47, "message_utf8_bytes": 113, "cache_tensor_bytes": null, "serialized_payload_bytes": 113, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5828.520458075218, "decode_payload_ms": 0.0, "receiver_prefill_ms": 138.74879200011492, "ttft_ms": 24.923749966546893, "decode_ms": 23.907874943688512}, "total_wall_ms": 188.33429098594934, "ttft_ms": 24.923749966546893, "input_usage": {"receiver_prompt_tokens": 143, "sender_input_tokens": 2115, "sender_output_tokens": 128, "sender_prefill_ms": 753.3047500764951, "sender_ttft_ms": 46.19274998549372, "sender_decode_ms": 5025.524459080771}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6284787712, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6304130160, "mlx_cache_bytes": 11100111869, "process_rss_bytes": 6284787712}, "peak_prefill_memory": null, "peak_decode_memory": 6304130160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2e2e9d8372d61bc2abf4d92635ab8105eb20a4de648105008806bc2d8f7c4d96", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 83 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "17730f009661178d0635a39e", "attempt_id": "11452778265a", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:18.752680Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 143, "message_tokens": 47, "message_utf8_bytes": 113, "cache_tensor_bytes": null, "serialized_payload_bytes": 113, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5828.520458075218, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.52950001042336, "ttft_ms": 42.7512499736622, "decode_ms": 46.38404201250523}, "total_wall_ms": 172.70062502939254, "ttft_ms": 42.7512499736622, "input_usage": {"receiver_prompt_tokens": 143, "sender_input_tokens": 2115, "sender_output_tokens": 128, "sender_prefill_ms": 753.3047500764951, "sender_ttft_ms": 46.19274998549372, "sender_decode_ms": 5025.524459080771}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6284836864, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6303622280, "mlx_cache_bytes": 11100701693, "process_rss_bytes": 6284836864}, "peak_prefill_memory": null, "peak_decode_memory": 6303622280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2e2e9d8372d61bc2abf4d92635ab8105eb20a4de648105008806bc2d8f7c4d96", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 84 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6d4124f6a346abb990d43447", "attempt_id": "8ad9e20eb066", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:18.947072Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 140, "message_tokens": 47, "message_utf8_bytes": 113, "cache_tensor_bytes": null, "serialized_payload_bytes": 113, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5828.520458075218, "decode_payload_ms": 0.0, "receiver_prefill_ms": 85.99408308509737, "ttft_ms": 49.946665996685624, "decode_ms": 44.71358307637274}, "total_wall_ms": 181.53095804154873, "ttft_ms": 49.946665996685624, "input_usage": {"receiver_prompt_tokens": 140, "sender_input_tokens": 2115, "sender_output_tokens": 128, "sender_prefill_ms": 753.3047500764951, "sender_ttft_ms": 46.19274998549372, "sender_decode_ms": 5025.524459080771}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6284902400, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6296282224, "mlx_cache_bytes": 11202921469, "process_rss_bytes": 6284902400}, "peak_prefill_memory": null, "peak_decode_memory": 6296282224, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2e2e9d8372d61bc2abf4d92635ab8105eb20a4de648105008806bc2d8f7c4d96", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 85 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a81983359faa7e0580c80157", "attempt_id": "7f2d9dc14deb", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:19.149874Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 148, "message_tokens": 47, "message_utf8_bytes": 113, "cache_tensor_bytes": null, "serialized_payload_bytes": 113, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5828.520458075218, "decode_payload_ms": 0.0, "receiver_prefill_ms": 141.34308299981058, "ttft_ms": 52.11175000295043, "decode_ms": 54.08625002019107}, "total_wall_ms": 248.3807080425322, "ttft_ms": 52.11175000295043, "input_usage": {"receiver_prompt_tokens": 148, "sender_input_tokens": 2115, "sender_output_tokens": 128, "sender_prefill_ms": 753.3047500764951, "sender_ttft_ms": 46.19274998549372, "sender_decode_ms": 5025.524459080771}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6284967936, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6300804208, "mlx_cache_bytes": 11283792893, "process_rss_bytes": 6284967936}, "peak_prefill_memory": null, "peak_decode_memory": 6300804208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2e2e9d8372d61bc2abf4d92635ab8105eb20a4de648105008806bc2d8f7c4d96", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 86 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "49d598190933f0afabf5e21c", "attempt_id": "0a4884b5bd7d", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:19.419645Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 146, "message_tokens": 47, "message_utf8_bytes": 113, "cache_tensor_bytes": null, "serialized_payload_bytes": 113, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5828.520458075218, "decode_payload_ms": 0.0, "receiver_prefill_ms": 88.31079106312245, "ttft_ms": 65.96333300694823, "decode_ms": 56.599291041493416}, "total_wall_ms": 211.74404106568545, "ttft_ms": 65.96333300694823, "input_usage": {"receiver_prompt_tokens": 146, "sender_input_tokens": 2115, "sender_output_tokens": 128, "sender_prefill_ms": 753.3047500764951, "sender_ttft_ms": 46.19274998549372, "sender_decode_ms": 5025.524459080771}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6285066240, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6299755632, "mlx_cache_bytes": 11334910973, "process_rss_bytes": 6285066240}, "peak_prefill_memory": null, "peak_decode_memory": 6299755632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2e2e9d8372d61bc2abf4d92635ab8105eb20a4de648105008806bc2d8f7c4d96", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 87 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "114d7f2656eacf1528ebd27f", "attempt_id": "8b3e5c0a31e2", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:19.650713Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 140, "message_tokens": 47, "message_utf8_bytes": 113, "cache_tensor_bytes": null, "serialized_payload_bytes": 113, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5828.520458075218, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.88616598211229, "ttft_ms": 37.94833295978606, "decode_ms": 18.885375000536442}, "total_wall_ms": 136.7663339478895, "ttft_ms": 37.94833295978606, "input_usage": {"receiver_prompt_tokens": 140, "sender_input_tokens": 2115, "sender_output_tokens": 128, "sender_prefill_ms": 753.3047500764951, "sender_ttft_ms": 46.19274998549372, "sender_decode_ms": 5025.524459080771}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6285131776, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6295676016, "mlx_cache_bytes": 11335484413, "process_rss_bytes": 6285131776}, "peak_prefill_memory": null, "peak_decode_memory": 6295676016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2e2e9d8372d61bc2abf4d92635ab8105eb20a4de648105008806bc2d8f7c4d96", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 88 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3396ea923653f571f36e80f0", "attempt_id": "5d35ccda8dd3", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:19.810367Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 138, "message_tokens": 47, "message_utf8_bytes": 113, "cache_tensor_bytes": null, "serialized_payload_bytes": 113, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5828.520458075218, "decode_payload_ms": 0.0, "receiver_prefill_ms": 107.40645905025303, "ttft_ms": 77.94937503058463, "decode_ms": 65.68274996243417}, "total_wall_ms": 251.8139169551432, "ttft_ms": 77.94937503058463, "input_usage": {"receiver_prompt_tokens": 138, "sender_input_tokens": 2115, "sender_output_tokens": 128, "sender_prefill_ms": 753.3047500764951, "sender_ttft_ms": 46.19274998549372, "sender_decode_ms": 5025.524459080771}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6285164544, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6294889584, "mlx_cache_bytes": 11383981053, "process_rss_bytes": 6285164544}, "peak_prefill_memory": null, "peak_decode_memory": 6294889584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2e2e9d8372d61bc2abf4d92635ab8105eb20a4de648105008806bc2d8f7c4d96", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 89 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "65223841c0da0d6fd8422676", "attempt_id": "02a458c506d4", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:50.076247Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 434, "message_tokens": 344, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29992.015082971193, "decode_payload_ms": 0.0, "receiver_prefill_ms": 364.8830000311136, "ttft_ms": 33.16437499597669, "decode_ms": 43.701917049475014}, "total_wall_ms": 443.91549995634705, "ttft_ms": 33.16437499597669, "input_usage": {"receiver_prompt_tokens": 434, "sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 940.3810419607908, "sender_ttft_ms": 44.13541697431356, "sender_decode_ms": 29004.778207978234}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6284083200, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6536111924, "mlx_cache_bytes": 11729046209, "process_rss_bytes": 6284083200}, "peak_prefill_memory": null, "peak_decode_memory": 6536111924, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "448fbefbbf3dc2a8c9785c435f1c717947c9d692820d830c64b908b542a8566e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 90 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7a9127107893ed6aae4a4e6e", "attempt_id": "dfb72412f5aa", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:50.547946Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 440, "message_tokens": 344, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29992.015082971193, "decode_payload_ms": 0.0, "receiver_prefill_ms": 265.50949993543327, "ttft_ms": 32.37508295569569, "decode_ms": 54.065417032688856}, "total_wall_ms": 353.77845796756446, "ttft_ms": 32.37508295569569, "input_usage": {"receiver_prompt_tokens": 440, "sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 940.3810419607908, "sender_ttft_ms": 44.13541697431356, "sender_decode_ms": 29004.778207978234}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6284197888, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6531884864, "mlx_cache_bytes": 12040393117, "process_rss_bytes": 6284197888}, "peak_prefill_memory": null, "peak_decode_memory": 6531884864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "448fbefbbf3dc2a8c9785c435f1c717947c9d692820d830c64b908b542a8566e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 91 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "65f8820ba46bd4578a6d92b4", "attempt_id": "b57e18ac7621", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:50.924594Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 440, "message_tokens": 344, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29992.015082971193, "decode_payload_ms": 0.0, "receiver_prefill_ms": 245.53833401296288, "ttft_ms": 56.499166996218264, "decode_ms": 47.08337504416704}, "total_wall_ms": 350.54616699926555, "ttft_ms": 56.499166996218264, "input_usage": {"receiver_prompt_tokens": 440, "sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 940.3810419607908, "sender_ttft_ms": 44.13541697431356, "sender_decode_ms": 29004.778207978234}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6284263424, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6538536816, "mlx_cache_bytes": 12062003613, "process_rss_bytes": 6284263424}, "peak_prefill_memory": null, "peak_decode_memory": 6538536816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "448fbefbbf3dc2a8c9785c435f1c717947c9d692820d830c64b908b542a8566e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 92 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8442e0bb92aef48fd05ac2ce", "attempt_id": "b46d6970a724", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:51.299045Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 437, "message_tokens": 344, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29992.015082971193, "decode_payload_ms": 0.0, "receiver_prefill_ms": 277.85641700029373, "ttft_ms": 42.986916028894484, "decode_ms": 56.898207985796034}, "total_wall_ms": 379.1518750367686, "ttft_ms": 42.986916028894484, "input_usage": {"receiver_prompt_tokens": 437, "sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 940.3810419607908, "sender_ttft_ms": 44.13541697431356, "sender_decode_ms": 29004.778207978234}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6284279808, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6537684812, "mlx_cache_bytes": 12301341085, "process_rss_bytes": 6284279808}, "peak_prefill_memory": null, "peak_decode_memory": 6537684812, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "448fbefbbf3dc2a8c9785c435f1c717947c9d692820d830c64b908b542a8566e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 93 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "43942fc2671f1164f4a366a8", "attempt_id": "2b7fe200dd67", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:51.701094Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 445, "message_tokens": 344, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29992.015082971193, "decode_payload_ms": 0.0, "receiver_prefill_ms": 323.8183750072494, "ttft_ms": 50.72587507311255, "decode_ms": 575.3746660193428}, "total_wall_ms": 951.2672499986365, "ttft_ms": 50.72587507311255, "input_usage": {"receiver_prompt_tokens": 445, "sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 940.3810419607908, "sender_ttft_ms": 44.13541697431356, "sender_decode_ms": 29004.778207978234}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 6280593408, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6543992672, "mlx_cache_bytes": 12632430733, "process_rss_bytes": 6280593408}, "peak_prefill_memory": null, "peak_decode_memory": 6543992672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172 NOK", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.6666666666666666}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "448fbefbbf3dc2a8c9785c435f1c717947c9d692820d830c64b908b542a8566e", "output_hash": "ce5dae2b035af8d38bda9e7d1f1cb7eb7e4141e20298d86d8bce5fe5ac6c0246"} | |
| 94 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "bc08d3f07374b4d8666c8240", "attempt_id": "70a270ecc729", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:52.680388Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 443, "message_tokens": 344, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29992.015082971193, "decode_payload_ms": 0.0, "receiver_prefill_ms": 221.60295792855322, "ttft_ms": 59.783500037156045, "decode_ms": 472.54674998112023}, "total_wall_ms": 755.125334020704, "ttft_ms": 59.783500037156045, "input_usage": {"receiver_prompt_tokens": 443, "sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 940.3810419607908, "sender_ttft_ms": 44.13541697431356, "sender_decode_ms": 29004.778207978234}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 6279692288, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6542813024, "mlx_cache_bytes": 12875045005, "process_rss_bytes": 6279692288}, "peak_prefill_memory": null, "peak_decode_memory": 6542813024, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BH-71Y-2851", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "448fbefbbf3dc2a8c9785c435f1c717947c9d692820d830c64b908b542a8566e", "output_hash": "38b55d8642902ac72f5987064e67fbe9b766a04dc338df11f6fa45d4cb64179e"} | |
| 95 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "816ed2125ce7b04e762b5743", "attempt_id": "18ce15c66489", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:53.456831Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 437, "message_tokens": 344, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29992.015082971193, "decode_payload_ms": 0.0, "receiver_prefill_ms": 240.14141701627523, "ttft_ms": 41.92666697781533, "decode_ms": 59.50945906806737}, "total_wall_ms": 342.6190000027418, "ttft_ms": 41.92666697781533, "input_usage": {"receiver_prompt_tokens": 437, "sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 940.3810419607908, "sender_ttft_ms": 44.13541697431356, "sender_decode_ms": 29004.778207978234}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6279806976, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6537684812, "mlx_cache_bytes": 12875045005, "process_rss_bytes": 6279806976}, "peak_prefill_memory": null, "peak_decode_memory": 6537684812, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "448fbefbbf3dc2a8c9785c435f1c717947c9d692820d830c64b908b542a8566e", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 96 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c71959c0d3e5357f7027f876", "attempt_id": "202e36495fb2", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:53.819679Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 435, "message_tokens": 344, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29992.015082971193, "decode_payload_ms": 0.0, "receiver_prefill_ms": 189.47916699107736, "ttft_ms": 131.1209590639919, "decode_ms": 48.01504104398191}, "total_wall_ms": 371.0270000156015, "ttft_ms": 131.1209590639919, "input_usage": {"receiver_prompt_tokens": 435, "sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 940.3810419607908, "sender_ttft_ms": 44.13541697431356, "sender_decode_ms": 29004.778207978234}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6279839744, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6536767308, "mlx_cache_bytes": 13113464973, "process_rss_bytes": 6279839744}, "peak_prefill_memory": null, "peak_decode_memory": 6536767308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "448fbefbbf3dc2a8c9785c435f1c717947c9d692820d830c64b908b542a8566e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 97 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ba2a8cdfd43ae8d3dda33750", "attempt_id": "eced51fba189", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:54.221815Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 141, "message_tokens": 51, "message_utf8_bytes": 117, "cache_tensor_bytes": null, "serialized_payload_bytes": 117, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4871.90762499813, "decode_payload_ms": 0.0, "receiver_prefill_ms": 163.6903330218047, "ttft_ms": 34.58358300849795, "decode_ms": 513.1103330058977}, "total_wall_ms": 5587.869332986884, "ttft_ms": 34.58358300849795, "input_usage": {"receiver_prompt_tokens": 141, "sender_input_tokens": 2123, "sender_output_tokens": 68, "sender_prefill_ms": 1078.6179170245305, "sender_ttft_ms": 71.23454206157476, "sender_decode_ms": 3716.0445830086246}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 6239371264, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6295151728, "mlx_cache_bytes": 13235624077, "process_rss_bytes": 6239371264}, "peak_prefill_memory": null, "peak_decode_memory": 6295151728, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f3dabf50da33366b917608aeefa49c1007a0cc60466cdae60beb550e66756bbb", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 98 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "22d7c540fa1569284e76b10d", "attempt_id": "ed9984b05a3b", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:51:59.853948Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 145, "message_tokens": 49, "message_utf8_bytes": 117, "cache_tensor_bytes": null, "serialized_payload_bytes": 117, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4692.283415934071, "decode_payload_ms": 0.0, "receiver_prefill_ms": 220.4554999480024, "ttft_ms": 58.05037508253008, "decode_ms": 158.4277079673484}, "total_wall_ms": 5618.514208937995, "ttft_ms": 58.05037508253008, "input_usage": {"receiver_prompt_tokens": 145, "sender_input_tokens": 2129, "sender_output_tokens": 64, "sender_prefill_ms": 1026.6934579703957, "sender_ttft_ms": 56.53862503822893, "sender_decode_ms": 3594.4499170873314}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6215139328, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6298887280, "mlx_cache_bytes": 13292771469, "process_rss_bytes": 6215139328}, "peak_prefill_memory": null, "peak_decode_memory": 6298887280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C in Schefferville", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9652ad7c55f3009c5be7436cce78588b23912163734f44f8d5832818ead6c55f", "output_hash": "3491362e6ed6bb557ea2c25e29286d6fdbd0a0a36995d38446eddfd8450e097c"} | |
| 99 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "74f83f0cb7ec6ed89fabe363", "attempt_id": "8d67161c6748", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:05.699446Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 146, "message_tokens": 50, "message_utf8_bytes": 115, "cache_tensor_bytes": null, "serialized_payload_bytes": 115, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3990.0535839842632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 769.0995839657262, "ttft_ms": 57.462334050796926, "decode_ms": 316.9130419846624}, "total_wall_ms": 5153.69558299426, "ttft_ms": 57.462334050796926, "input_usage": {"receiver_prompt_tokens": 146, "sender_input_tokens": 2129, "sender_output_tokens": 61, "sender_prefill_ms": 1754.6524999197572, "sender_ttft_ms": 47.18887491617352, "sender_decode_ms": 2178.2806670526043}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1690402816, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6299755632, "mlx_cache_bytes": 13292771469, "process_rss_bytes": 1690402816}, "peak_prefill_memory": null, "peak_decode_memory": 6299755632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0484c7585de7098cb92373463b2c069927504a9946d31a9ca025d1a1167fabc5", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 100 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5a142f30cf64f0c904f3e59b", "attempt_id": "8adbee89466e", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:11.707981Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 141, "message_tokens": 48, "message_utf8_bytes": 118, "cache_tensor_bytes": null, "serialized_payload_bytes": 118, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5765.988125000149, "decode_payload_ms": 0.0, "receiver_prefill_ms": 608.8366659823805, "ttft_ms": 161.4062919979915, "decode_ms": 745.7209579879418}, "total_wall_ms": 7289.483958971687, "ttft_ms": 161.4062919979915, "input_usage": {"receiver_prompt_tokens": 141, "sender_input_tokens": 2126, "sender_output_tokens": 77, "sender_prefill_ms": 1012.2772080358118, "sender_ttft_ms": 57.683915947563946, "sender_decode_ms": 4690.014833933674}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1691844608, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6295151728, "mlx_cache_bytes": 13320558733, "process_rss_bytes": 1691844608}, "peak_prefill_memory": null, "peak_decode_memory": 6295151728, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "904688de4b65b2f491fa2b715cc1c916e51e218dddc902c4585a7ed8ac38e786", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 101 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "39a2830786ba716d51b9e097", "attempt_id": "cb73da0dc216", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:19.059089Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 153, "message_tokens": 52, "message_utf8_bytes": 123, "cache_tensor_bytes": null, "serialized_payload_bytes": 123, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8046.766332932748, "decode_payload_ms": 0.0, "receiver_prefill_ms": 412.3260419582948, "ttft_ms": 58.95604193210602, "decode_ms": 739.9513330310583}, "total_wall_ms": 9260.830290964805, "ttft_ms": 58.95604193210602, "input_usage": {"receiver_prompt_tokens": 153, "sender_input_tokens": 2134, "sender_output_tokens": 100, "sender_prefill_ms": 1188.6862500105053, "sender_ttft_ms": 54.72245905548334, "sender_decode_ms": 6797.676082933322}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 1693466624, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6305293424, "mlx_cache_bytes": 13420566669, "process_rss_bytes": 1693466624}, "peak_prefill_memory": null, "peak_decode_memory": 6305293424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172 NOK", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.6666666666666666}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "8204a82f1decc01f3bb75bcfd65fcc9f2ca508a0bd791a8f43e1d8e066d0efb9", "output_hash": "ce5dae2b035af8d38bda9e7d1f1cb7eb7e4141e20298d86d8bce5fe5ac6c0246"} | |
| 102 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5588aea7edf4c02460260f4a", "attempt_id": "b14f494e8798", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:28.357852Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 146, "message_tokens": 47, "message_utf8_bytes": 116, "cache_tensor_bytes": null, "serialized_payload_bytes": 116, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5077.3695829557255, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.33833295293152, "ttft_ms": 59.133582981303334, "decode_ms": 689.989916048944}, "total_wall_ms": 5974.0480419714, "ttft_ms": 59.133582981303334, "input_usage": {"receiver_prompt_tokens": 146, "sender_input_tokens": 2132, "sender_output_tokens": 64, "sender_prefill_ms": 1066.8570840498433, "sender_ttft_ms": 87.63541700318456, "sender_decode_ms": 3917.154208989814}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1691222016, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6299755632, "mlx_cache_bytes": 13467342989, "process_rss_bytes": 1691222016}, "peak_prefill_memory": null, "peak_decode_memory": 6299755632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SP-38G-4217", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1c4fa9d9ef27d880d8e001d842031994d04310a6e547ac6de726ad73dc66d03d", "output_hash": "e643c21a78559b96fd65325d9ce779b7b8fd6a47c53cf7c2cda1efa8412458c4"} | |
| 103 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "bcd3acbe0f3d95a105aa30b2", "attempt_id": "eb28c3804423", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:34.375593Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 137, "message_tokens": 44, "message_utf8_bytes": 110, "cache_tensor_bytes": null, "serialized_payload_bytes": 110, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5784.818125073798, "decode_payload_ms": 0.0, "receiver_prefill_ms": 415.22275004535913, "ttft_ms": 34.29595800116658, "decode_ms": 36.267624935135245}, "total_wall_ms": 6273.845667019486, "ttft_ms": 34.29595800116658, "input_usage": {"receiver_prompt_tokens": 137, "sender_input_tokens": 2126, "sender_output_tokens": 66, "sender_prefill_ms": 1249.5219999691471, "sender_ttft_ms": 79.78362508583814, "sender_decode_ms": 4450.788166956045}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1690255360, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6291530864, "mlx_cache_bytes": 13467342989, "process_rss_bytes": 1690255360}, "peak_prefill_memory": null, "peak_decode_memory": 6291530864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "8f10f95ff2ae53b376c8c654d82ff6f515acf8c6218364c4ab0e748c7680e868", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 104 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c3ba77cc9873d1268b158210", "attempt_id": "43c7d5ca78d9", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:40.687184Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 132, "message_tokens": 41, "message_utf8_bytes": 103, "cache_tensor_bytes": null, "serialized_payload_bytes": 103, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4641.5456250542775, "decode_payload_ms": 0.0, "receiver_prefill_ms": 265.1204589055851, "ttft_ms": 60.9997499268502, "decode_ms": 67.1607090625912}, "total_wall_ms": 5039.716250030324, "ttft_ms": 60.9997499268502, "input_usage": {"receiver_prompt_tokens": 132, "sender_input_tokens": 2124, "sender_output_tokens": 50, "sender_prefill_ms": 1234.726291964762, "sender_ttft_ms": 28.936250018887222, "sender_decode_ms": 3374.0929579362273}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1691385856, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6294971504, "mlx_cache_bytes": 13561518221, "process_rss_bytes": 1691385856}, "peak_prefill_memory": null, "peak_decode_memory": 6294971504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "5fe520b019760ea0d31869b9808981ded50acb1dedef01a23bc802a10e688067", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 105 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "b469fc12ea505953e18a56f7", "attempt_id": "83e415ae1f39", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:21.405549Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 7}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 1045, "message_tokens": 970, "message_utf8_bytes": 623, "cache_tensor_bytes": null, "serialized_payload_bytes": 623, "side_information_bytes": 0, "fetched_bytes": 1634, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 35642.67829200253, "decode_payload_ms": 0.0, "receiver_prefill_ms": 378.01750004291534, "ttft_ms": 47.55725001450628, "decode_ms": 145.22933401167393}, "total_wall_ms": 592.0917090261355, "ttft_ms": 47.55725001450628, "input_usage": {"receiver_prompt_tokens": 1045, "sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 1526.9413749920204, "sender_ttft_ms": 87.4640840338543, "sender_decode_ms": 34020.01454192214}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1437990912, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6818201660, "mlx_cache_bytes": 14222366861, "process_rss_bytes": 1437990912}, "peak_prefill_memory": null, "peak_decode_memory": 6818201660, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1634, "retrieved_refs": 6}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "561d3553701d834273477e7e81d6f4a2903e1fe9e09b5b4efdd73a721bde815e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 106 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "79d87ef074645777b892e823", "attempt_id": "6a8dab0a92ab", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:22.029246Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 7}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 1051, "message_tokens": 970, "message_utf8_bytes": 623, "cache_tensor_bytes": null, "serialized_payload_bytes": 623, "side_information_bytes": 0, "fetched_bytes": 1634, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 35642.67829200253, "decode_payload_ms": 0.0, "receiver_prefill_ms": 541.6967920027673, "ttft_ms": 85.35870804917067, "decode_ms": 63.60841600690037}, "total_wall_ms": 693.0375420488417, "ttft_ms": 85.35870804917067, "input_usage": {"receiver_prompt_tokens": 1051, "sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 1526.9413749920204, "sender_ttft_ms": 87.4640840338543, "sender_decode_ms": 34020.01454192214}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1442496512, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6821904444, "mlx_cache_bytes": 14839896205, "process_rss_bytes": 1442496512}, "peak_prefill_memory": null, "peak_decode_memory": 6821904444, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1634, "retrieved_refs": 6}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ab0e9c7021e297c7521daf9f4fa54de8136f15dc9e1c13a37a4af71f57687c8e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 107 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0ae7cfeab51e1be141e559e2", "attempt_id": "7f47242b6bba", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:22.747613Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 7}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 1051, "message_tokens": 970, "message_utf8_bytes": 623, "cache_tensor_bytes": null, "serialized_payload_bytes": 623, "side_information_bytes": 0, "fetched_bytes": 1634, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 35642.67829200253, "decode_payload_ms": 0.0, "receiver_prefill_ms": 494.5004169130698, "ttft_ms": 120.40316697675735, "decode_ms": 77.48079195152968}, "total_wall_ms": 694.4931669859216, "ttft_ms": 120.40316697675735, "input_usage": {"receiver_prompt_tokens": 1051, "sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 1526.9413749920204, "sender_ttft_ms": 87.4640840338543, "sender_decode_ms": 34020.01454192214}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1442250752, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6821904444, "mlx_cache_bytes": 14839896205, "process_rss_bytes": 1442250752}, "peak_prefill_memory": null, "peak_decode_memory": 6821904444, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1634, "retrieved_refs": 6}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ab0e9c7021e297c7521daf9f4fa54de8136f15dc9e1c13a37a4af71f57687c8e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 108 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4c71988a2be93c8ed7c69a57", "attempt_id": "3a46e9dbd7eb", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:23.468816Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 7}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 1048, "message_tokens": 970, "message_utf8_bytes": 623, "cache_tensor_bytes": null, "serialized_payload_bytes": 623, "side_information_bytes": 0, "fetched_bytes": 1634, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 35642.67829200253, "decode_payload_ms": 0.0, "receiver_prefill_ms": 461.9608750799671, "ttft_ms": 76.96991600096226, "decode_ms": 63.66766698192805}, "total_wall_ms": 605.1674999762326, "ttft_ms": 76.96991600096226, "input_usage": {"receiver_prompt_tokens": 1048, "sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 1526.9413749920204, "sender_ttft_ms": 87.4640840338543, "sender_decode_ms": 34020.01454192214}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1441071104, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6850789436, "mlx_cache_bytes": 15313885325, "process_rss_bytes": 1441071104}, "peak_prefill_memory": null, "peak_decode_memory": 6850789436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1634, "retrieved_refs": 6}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ab0e9c7021e297c7521daf9f4fa54de8136f15dc9e1c13a37a4af71f57687c8e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 109 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9dca3b4c66d92aa3b42c1b1d", "attempt_id": "f69bd7f9a628", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:24.102955Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 7}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 1056, "message_tokens": 970, "message_utf8_bytes": 623, "cache_tensor_bytes": null, "serialized_payload_bytes": 623, "side_information_bytes": 0, "fetched_bytes": 1634, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 35642.67829200253, "decode_payload_ms": 0.0, "receiver_prefill_ms": 458.21570802945644, "ttft_ms": 89.71616707276553, "decode_ms": 565.710791037418}, "total_wall_ms": 1115.8437500707805, "ttft_ms": 89.71616707276553, "input_usage": {"receiver_prompt_tokens": 1056, "sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 1526.9413749920204, "sender_ttft_ms": 87.4640840338543, "sender_decode_ms": 34020.01454192214}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1440825344, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6824689724, "mlx_cache_bytes": 15934281869, "process_rss_bytes": 1440825344}, "peak_prefill_memory": null, "peak_decode_memory": 6824689724, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1634, "retrieved_refs": 6}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ab0e9c7021e297c7521daf9f4fa54de8136f15dc9e1c13a37a4af71f57687c8e", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 110 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f01b5e31b9d46d292e06da03", "attempt_id": "ec1a8cee9b17", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:25.242074Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 7}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 1054, "message_tokens": 970, "message_utf8_bytes": 623, "cache_tensor_bytes": null, "serialized_payload_bytes": 623, "side_information_bytes": 0, "fetched_bytes": 1634, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 35642.67829200253, "decode_payload_ms": 0.0, "receiver_prefill_ms": 561.0457910224795, "ttft_ms": 73.62216606270522, "decode_ms": 76.63941592909396}, "total_wall_ms": 714.6227919729427, "ttft_ms": 73.62216606270522, "input_usage": {"receiver_prompt_tokens": 1054, "sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 1526.9413749920204, "sender_ttft_ms": 87.4640840338543, "sender_decode_ms": 34020.01454192214}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1442168832, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6823804988, "mlx_cache_bytes": 16367802509, "process_rss_bytes": 1442168832}, "peak_prefill_memory": null, "peak_decode_memory": 6823804988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1634, "retrieved_refs": 6}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "561d3553701d834273477e7e81d6f4a2903e1fe9e09b5b4efdd73a721bde815e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 111 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "360276a13afb2d41417e890d", "attempt_id": "96c0dbfa9158", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:25.983297Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 7}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 1048, "message_tokens": 970, "message_utf8_bytes": 623, "cache_tensor_bytes": null, "serialized_payload_bytes": 623, "side_information_bytes": 0, "fetched_bytes": 1634, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 35642.67829200253, "decode_payload_ms": 0.0, "receiver_prefill_ms": 497.2743750549853, "ttft_ms": 80.10491693858057, "decode_ms": 52.842916920781136}, "total_wall_ms": 632.7891250839457, "ttft_ms": 80.10491693858057, "input_usage": {"receiver_prompt_tokens": 1048, "sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 1526.9413749920204, "sender_ttft_ms": 87.4640840338543, "sender_decode_ms": 34020.01454192214}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1442299904, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6855032892, "mlx_cache_bytes": 16367802509, "process_rss_bytes": 1442299904}, "peak_prefill_memory": null, "peak_decode_memory": 6855032892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1634, "retrieved_refs": 6}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ab0e9c7021e297c7521daf9f4fa54de8136f15dc9e1c13a37a4af71f57687c8e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 112 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e908282eb7cc900972572715", "attempt_id": "eab2dcbcb36e", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:26.640776Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 7}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 1046, "message_tokens": 970, "message_utf8_bytes": 623, "cache_tensor_bytes": null, "serialized_payload_bytes": 623, "side_information_bytes": 0, "fetched_bytes": 1634, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 35642.67829200253, "decode_payload_ms": 0.0, "receiver_prefill_ms": 502.8000839520246, "ttft_ms": 92.95654203742743, "decode_ms": 70.77137497253716}, "total_wall_ms": 669.1975829889998, "ttft_ms": 92.95654203742743, "input_usage": {"receiver_prompt_tokens": 1046, "sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 1526.9413749920204, "sender_ttft_ms": 87.4640840338543, "sender_decode_ms": 34020.01454192214}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1442349056, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6854344764, "mlx_cache_bytes": 16798177421, "process_rss_bytes": 1442349056}, "peak_prefill_memory": null, "peak_decode_memory": 6854344764, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1634, "retrieved_refs": 6}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ab0e9c7021e297c7521daf9f4fa54de8136f15dc9e1c13a37a4af71f57687c8e", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 113 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ac30ac2b8b432c7b33420750", "attempt_id": "8d3b43d971cd", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:27.376585Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 3.5135135135135136}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2045, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 2072, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 39.819792029447854, "decode_payload_ms": 0.29975001234561205, "receiver_prefill_ms": 4354.247833020054, "ttft_ms": 231.00641707424074, "decode_ms": 1004.8636249266565}, "total_wall_ms": 5597.181500052102, "ttft_ms": 231.00641707424074, "input_usage": {"receiver_prompt_tokens": 2045}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 245317632, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7061651504, "mlx_cache_bytes": 16798177421, "process_rss_bytes": 245317632}, "peak_prefill_memory": null, "peak_decode_memory": 7061651504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 114 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2713cf06493be2d1b061fee3", "attempt_id": "c0d0f989295e", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:32.996839Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 3.5135135135135136}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2051, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 2072, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 39.819792029447854, "decode_payload_ms": 0.29975001234561205, "receiver_prefill_ms": 4630.934291984886, "ttft_ms": 23.955959011800587, "decode_ms": 422.55058290902525}, "total_wall_ms": 5082.146625034511, "ttft_ms": 23.955959011800587, "input_usage": {"receiver_prompt_tokens": 2051}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 56459264, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7054786612, "mlx_cache_bytes": 16798177421, "process_rss_bytes": 56459264}, "peak_prefill_memory": null, "peak_decode_memory": 7054786612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "b6582a041b3d2b38ac6924099568ca2e6f1a610c6fb5f4de2e0516b90433bc2a"} | |
| 115 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "919ff6dc3f9281577d51d172", "attempt_id": "ee701fe8b615", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:38.106049Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 3.5135135135135136}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2051, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 2072, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 39.819792029447854, "decode_payload_ms": 0.29975001234561205, "receiver_prefill_ms": 848.609208012931, "ttft_ms": 24.180709035135806, "decode_ms": 170.95233302097768}, "total_wall_ms": 1054.8324170522392, "ttft_ms": 24.180709035135806, "input_usage": {"receiver_prompt_tokens": 2051}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 57016320, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7054786612, "mlx_cache_bytes": 16798177421, "process_rss_bytes": 57016320}, "peak_prefill_memory": null, "peak_decode_memory": 7054786612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 116 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0f36651cea9cff68239c7838", "attempt_id": "47d568264d49", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:39.193348Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 3.5135135135135136}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2048, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 2072, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 39.819792029447854, "decode_payload_ms": 0.29975001234561205, "receiver_prefill_ms": 845.6971660489216, "ttft_ms": 41.79829196073115, "decode_ms": 663.4332499234006}, "total_wall_ms": 1657.8844169853255, "ttft_ms": 41.79829196073115, "input_usage": {"receiver_prompt_tokens": 2048}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 47415296, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7063175232, "mlx_cache_bytes": 16798177421, "process_rss_bytes": 47415296}, "peak_prefill_memory": null, "peak_decode_memory": 7063175232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 117 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1e9b39b54393c0c1c02f47b8", "attempt_id": "c165df7325ab", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:40.890183Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 3.5135135135135136}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2056, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 2072, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 39.819792029447854, "decode_payload_ms": 0.29975001234561205, "receiver_prefill_ms": 690.7639999408275, "ttft_ms": 41.85066593345255, "decode_ms": 357.3740000138059}, "total_wall_ms": 1096.705208066851, "ttft_ms": 41.85066593345255, "input_usage": {"receiver_prompt_tokens": 2056}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 57409536, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7054792797, "mlx_cache_bytes": 16798177421, "process_rss_bytes": 57409536}, "peak_prefill_memory": null, "peak_decode_memory": 7054792797, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6889172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "adcb8d196080006451756ad2fe2106d5a1b6500c0f76ffaa05d7fe704243ad3b"} | |
| 118 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "cd633990feda5f0bef12034c", "attempt_id": "635746671566", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:42.112634Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 3.5135135135135136}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2054, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 2072, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 39.819792029447854, "decode_payload_ms": 0.29975001234561205, "receiver_prefill_ms": 779.1565000079572, "ttft_ms": 53.26924996916205, "decode_ms": 484.53966702800244}, "total_wall_ms": 1322.8936250088736, "ttft_ms": 53.26924996916205, "input_usage": {"receiver_prompt_tokens": 2054}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 56623104, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7054792797, "mlx_cache_bytes": 16798177421, "process_rss_bytes": 56623104}, "peak_prefill_memory": null, "peak_decode_memory": 7054792797, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SP-38G-4217", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "e643c21a78559b96fd65325d9ce779b7b8fd6a47c53cf7c2cda1efa8412458c4"} | |
| 119 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "91aee09f95fdd9157afefac1", "attempt_id": "cb67f30319df", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:43.460009Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 3.5135135135135136}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2048, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 2072, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 39.819792029447854, "decode_payload_ms": 0.29975001234561205, "receiver_prefill_ms": 760.179084027186, "ttft_ms": 47.706791083328426, "decode_ms": 55.15999998897314}, "total_wall_ms": 866.7989170644432, "ttft_ms": 47.706791083328426, "input_usage": {"receiver_prompt_tokens": 2048}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 57098240, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7063175232, "mlx_cache_bytes": 16798177421, "process_rss_bytes": 57098240}, "peak_prefill_memory": null, "peak_decode_memory": 7063175232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 120 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "174b32ecb6104665ab692120", "attempt_id": "f451067dc38f", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "d7fbbfa78a1b00df1963068522ef3d136b604128276634399fd3eee67f781637", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:44.350599Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 3.5135135135135136}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2046, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 2072, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 39.819792029447854, "decode_payload_ms": 0.29975001234561205, "receiver_prefill_ms": 2192.5274999812245, "ttft_ms": 74.35687503311783, "decode_ms": 55.369207984767854}, "total_wall_ms": 2326.2041250709444, "ttft_ms": 74.35687503311783, "input_usage": {"receiver_prompt_tokens": 2046}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 57180160, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7062388800, "mlx_cache_bytes": 16798177421, "process_rss_bytes": 57180160}, "peak_prefill_memory": null, "peak_decode_memory": 7062388800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | |
| 121 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "279d8b722165cabc9226b358", "attempt_id": "d58f4302ef5e", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:55:01.338876Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2597666159309995, "origin_tokens": 1766, "compressed_tokens": 552, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 749, "message_tokens": 673, "message_utf8_bytes": 1901, "cache_tensor_bytes": null, "serialized_payload_bytes": 1901, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 32285.182291991077, "decode_payload_ms": 0.0, "receiver_prefill_ms": 24393.165249959566, "ttft_ms": 20765.287874964997, "decode_ms": 80176.83241702616}, "total_wall_ms": 125422.81791707501, "ttft_ms": 20765.287874964997, "input_usage": {"receiver_prompt_tokens": 749}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 204587008, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6651358216, "mlx_cache_bytes": 492087292, "process_rss_bytes": 204587008}, "peak_prefill_memory": null, "peak_decode_memory": 6651358216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "de22f94c4433681b0a927b8c9becabd6a356dc8451924add5adb90472d4a9bdc", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 122 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "966e0a4e843f1f6f8e0409ab", "attempt_id": "3b2fa3c786fb", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:57:06.875896Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2597666159309995, "origin_tokens": 1766, "compressed_tokens": 552, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 755, "message_tokens": 673, "message_utf8_bytes": 1901, "cache_tensor_bytes": null, "serialized_payload_bytes": 1901, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 32285.182291991077, "decode_payload_ms": 0.0, "receiver_prefill_ms": 15566.239541047253, "ttft_ms": 21677.49995808117, "decode_ms": 85318.63916595466}, "total_wall_ms": 122608.2591660088, "ttft_ms": 21677.49995808117, "input_usage": {"receiver_prompt_tokens": 755}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 47808512, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6655291480, "mlx_cache_bytes": 951363580, "process_rss_bytes": 47808512}, "peak_prefill_memory": null, "peak_decode_memory": 6655291480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "de22f94c4433681b0a927b8c9becabd6a356dc8451924add5adb90472d4a9bdc", "output_hash": "620632e3a4d38128fdc81039176e9ca7b44bb1593e3f778652709568225a772b"} | |
| 123 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2e4429c4fac16489b3bee409", "attempt_id": "e605803a1203", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:09.553196Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2597666159309995, "origin_tokens": 1766, "compressed_tokens": 552, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 755, "message_tokens": 673, "message_utf8_bytes": 1901, "cache_tensor_bytes": null, "serialized_payload_bytes": 1901, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 32285.182291991077, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1988.4534999728203, "ttft_ms": 56.966249947436154, "decode_ms": 461.8136660428718}, "total_wall_ms": 2518.857416929677, "ttft_ms": 56.966249947436154, "input_usage": {"receiver_prompt_tokens": 755}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 63848448, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6655291480, "mlx_cache_bytes": 951363580, "process_rss_bytes": 63848448}, "peak_prefill_memory": null, "peak_decode_memory": 6655291480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "71. 2449", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "de22f94c4433681b0a927b8c9becabd6a356dc8451924add5adb90472d4a9bdc", "output_hash": "10a9b36bf447655a418edd0d42d693f04d09dc9b21e23caa5ac3606fade43800"} | |
| 124 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "70c2ceb5ce8ff3b887c236ca", "attempt_id": "574a02ba0e67", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:12.137951Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2597666159309995, "origin_tokens": 1766, "compressed_tokens": 552, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 752, "message_tokens": 673, "message_utf8_bytes": 1901, "cache_tensor_bytes": null, "serialized_payload_bytes": 1901, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 32285.182291991077, "decode_payload_ms": 0.0, "receiver_prefill_ms": 364.38358295708895, "ttft_ms": 52.571208914741874, "decode_ms": 2679.71958394628}, "total_wall_ms": 3101.1328749591485, "ttft_ms": 52.571208914741874, "input_usage": {"receiver_prompt_tokens": 752}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 65290240, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6669299788, "mlx_cache_bytes": 1334716412, "process_rss_bytes": 65290240}, "peak_prefill_memory": null, "peak_decode_memory": 6669299788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Eshtal-12 proposed Oksana Okonkwo October 2030 budget, 336. February 2031 revised, 767.2031 budget Eshtal", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "de22f94c4433681b0a927b8c9becabd6a356dc8451924add5adb90472d4a9bdc", "output_hash": "f2005847552db685445106002595bfeea7d3cc8652091b8366900a4888c8b62d"} | |
| 125 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2b2b1c40fcff26d17ef62b15", "attempt_id": "701ad57adecc", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:15.266736Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2597666159309995, "origin_tokens": 1766, "compressed_tokens": 552, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 760, "message_tokens": 673, "message_utf8_bytes": 1901, "cache_tensor_bytes": null, "serialized_payload_bytes": 1901, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 32285.182291991077, "decode_payload_ms": 0.0, "receiver_prefill_ms": 426.6626660246402, "ttft_ms": 86.61887503694743, "decode_ms": 169.83833292033523}, "total_wall_ms": 684.7365000285208, "ttft_ms": 86.61887503694743, "input_usage": {"receiver_prompt_tokens": 760}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 65486848, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6657896536, "mlx_cache_bytes": 1777969148, "process_rss_bytes": 65486848}, "peak_prefill_memory": null, "peak_decode_memory": 6657896536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "889", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "de22f94c4433681b0a927b8c9becabd6a356dc8451924add5adb90472d4a9bdc", "output_hash": "a829c72c42755e384141ad8f163e4965ef5c9f8f0e07378c1d05a7222af0dd80"} | |
| 126 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "acaabc6e4d4c49b34962e380", "attempt_id": "634c79534f08", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:17.030978Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6321692680}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112716, "side_information_bytes": 16076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1054.6357079874724, "doc_prefill_ms": 978.4983330173418, "compress_ms": 12.819958967156708, "serialize_ms": 51.819249987602234, "load_ms": 4.219291964545846, "receiver_prefill_ms": 0.0, "query_prefill_ms": 88.34758296143264, "ttft_ms": 88.34758296143264, "decode_ms": 593.2706659659743}, "total_wall_ms": 688.8123749522492, "ttft_ms": 88.34758296143264, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 35}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 220413952, "backend_memory": {"mlx_active_bytes": 6398369800, "mlx_peak_bytes": 6443311308, "mlx_cache_bytes": 2791001414, "process_rss_bytes": 220413952}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6443311308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0fd1e41ac9de2a394237f6d73e79f07db7814fc3daad26bdafb5187f0b9128ae", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 127 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8a936ce40733cee79b7ce20f", "attempt_id": "44ff31a847c1", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:17.743323Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6321692680}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112716, "side_information_bytes": 16076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1054.6357079874724, "doc_prefill_ms": 978.4983330173418, "compress_ms": 12.819958967156708, "serialize_ms": 51.819249987602234, "load_ms": 3.2108330633491278, "receiver_prefill_ms": 0.0, "query_prefill_ms": 82.17745902948081, "ttft_ms": 82.17745902948081, "decode_ms": 468.55266601778567}, "total_wall_ms": 557.0991659769788, "ttft_ms": 82.17745902948081, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 220889088, "backend_memory": {"mlx_active_bytes": 6398369800, "mlx_peak_bytes": 6450127076, "mlx_cache_bytes": 2831355534, "process_rss_bytes": 220889088}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6450127076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0fd1e41ac9de2a394237f6d73e79f07db7814fc3daad26bdafb5187f0b9128ae", "output_hash": "b6582a041b3d2b38ac6924099568ca2e6f1a610c6fb5f4de2e0516b90433bc2a"} | |
| 128 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "77373cac251170265921d9e9", "attempt_id": "24817c9f86d9", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:18.327873Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6321692680}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112716, "side_information_bytes": 16076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1054.6357079874724, "doc_prefill_ms": 978.4983330173418, "compress_ms": 12.819958967156708, "serialize_ms": 51.819249987602234, "load_ms": 1.7341249622404575, "receiver_prefill_ms": 0.0, "query_prefill_ms": 62.84120795316994, "ttft_ms": 62.84120795316994, "decode_ms": 408.66533399093896}, "total_wall_ms": 482.51424997579306, "ttft_ms": 62.84120795316994, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 221806592, "backend_memory": {"mlx_active_bytes": 6398369800, "mlx_peak_bytes": 6450127076, "mlx_cache_bytes": 2831355534, "process_rss_bytes": 221806592}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6450127076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0fd1e41ac9de2a394237f6d73e79f07db7814fc3daad26bdafb5187f0b9128ae", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 129 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e9dbabb20e5ecf6825c093f9", "attempt_id": "73ed99a053fb", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:18.831982Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6321692680}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112716, "side_information_bytes": 16076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1054.6357079874724, "doc_prefill_ms": 978.4983330173418, "compress_ms": 12.819958967156708, "serialize_ms": 51.819249987602234, "load_ms": 1.9901669584214687, "receiver_prefill_ms": 0.0, "query_prefill_ms": 418.13612496480346, "ttft_ms": 418.13612496480346, "decode_ms": 330.44787496328354}, "total_wall_ms": 752.8034159913659, "ttft_ms": 418.13612496480346, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 38}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 222478336, "backend_memory": {"mlx_active_bytes": 6398369800, "mlx_peak_bytes": 6448701668, "mlx_cache_bytes": 2860700722, "process_rss_bytes": 222478336}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6448701668, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0fd1e41ac9de2a394237f6d73e79f07db7814fc3daad26bdafb5187f0b9128ae", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 130 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1d1e50b0f0e309dfdab391d3", "attempt_id": "31f55af6e6be", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:19.611557Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6321692680}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112716, "side_information_bytes": 16076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1054.6357079874724, "doc_prefill_ms": 978.4983330173418, "compress_ms": 12.819958967156708, "serialize_ms": 51.819249987602234, "load_ms": 1.3780000153928995, "receiver_prefill_ms": 0.0, "query_prefill_ms": 67.90320901200175, "ttft_ms": 67.90320901200175, "decode_ms": 415.6412499723956}, "total_wall_ms": 486.8782910052687, "ttft_ms": 67.90320901200175, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 222527488, "backend_memory": {"mlx_active_bytes": 6398369800, "mlx_peak_bytes": 6454108408, "mlx_cache_bytes": 2903135650, "process_rss_bytes": 222527488}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6454108408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6889172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0fd1e41ac9de2a394237f6d73e79f07db7814fc3daad26bdafb5187f0b9128ae", "output_hash": "adcb8d196080006451756ad2fe2106d5a1b6500c0f76ffaa05d7fe704243ad3b"} | |
| 131 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "b6c460332a7cf3d5fadc37fa", "attempt_id": "4012c407ee61", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:20.150779Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6321692680}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": "5934e1e7b2bd92f6", "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112744, "side_information_bytes": 16104, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.612625017762184, "doc_prefill_ms": 978.4983330173418, "compress_ms": 2.880375017412007, "serialize_ms": 26.52341697830707, "load_ms": 37.262209109030664, "receiver_prefill_ms": 0.0, "query_prefill_ms": 86.25749999191612, "ttft_ms": 86.25749999191612, "decode_ms": 548.937665997073}, "total_wall_ms": 674.4144590338692, "ttft_ms": 86.25749999191612, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 35}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 297304064, "backend_memory": {"mlx_active_bytes": 6398369800, "mlx_peak_bytes": 6443311308, "mlx_cache_bytes": 2903135650, "process_rss_bytes": 297304064}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6443311308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "eb4d9d05bd93beebadeb0b446aca6f8cd3f69a85009c57c2686509661e53bad1", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 132 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "14d5e1a8f0c5f483f2ca4ce7", "attempt_id": "1c6f599033bc", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:20.850633Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6321692680}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": "5934e1e7b2bd92f6", "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112744, "side_information_bytes": 16104, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.612625017762184, "doc_prefill_ms": 978.4983330173418, "compress_ms": 2.880375017412007, "serialize_ms": 26.52341697830707, "load_ms": 15.384000027552247, "receiver_prefill_ms": 0.0, "query_prefill_ms": 88.41804193798453, "ttft_ms": 88.41804193798453, "decode_ms": 505.07045804988593}, "total_wall_ms": 611.153458012268, "ttft_ms": 88.41804193798453, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 297353216, "backend_memory": {"mlx_active_bytes": 6398369800, "mlx_peak_bytes": 6450127076, "mlx_cache_bytes": 2903135650, "process_rss_bytes": 297353216}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6450127076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "eb4d9d05bd93beebadeb0b446aca6f8cd3f69a85009c57c2686509661e53bad1", "output_hash": "b6582a041b3d2b38ac6924099568ca2e6f1a610c6fb5f4de2e0516b90433bc2a"} | |
| 133 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ea781cec6fc361596c57c44b", "attempt_id": "b6d981c46bf5", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:21.490666Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6321692680}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": "5934e1e7b2bd92f6", "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112744, "side_information_bytes": 16104, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.612625017762184, "doc_prefill_ms": 978.4983330173418, "compress_ms": 2.880375017412007, "serialize_ms": 26.52341697830707, "load_ms": 12.7028749557212, "receiver_prefill_ms": 0.0, "query_prefill_ms": 87.66562503296882, "ttft_ms": 87.66562503296882, "decode_ms": 407.7478339895606}, "total_wall_ms": 510.0972499931231, "ttft_ms": 87.66562503296882, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 297418752, "backend_memory": {"mlx_active_bytes": 6398369800, "mlx_peak_bytes": 6450127076, "mlx_cache_bytes": 2903135650, "process_rss_bytes": 297418752}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6450127076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "eb4d9d05bd93beebadeb0b446aca6f8cd3f69a85009c57c2686509661e53bad1", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 134 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "b5ec1737c47385416e969667", "attempt_id": "04d7bcbbb57d", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:22.024532Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6321692680}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": "5934e1e7b2bd92f6", "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112744, "side_information_bytes": 16104, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.612625017762184, "doc_prefill_ms": 978.4983330173418, "compress_ms": 2.880375017412007, "serialize_ms": 26.52341697830707, "load_ms": 14.886916964314878, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.55716696474701, "ttft_ms": 73.55716696474701, "decode_ms": 298.2067910488695}, "total_wall_ms": 388.62062501721084, "ttft_ms": 73.55716696474701, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 38}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 297451520, "backend_memory": {"mlx_active_bytes": 6398369800, "mlx_peak_bytes": 6448586980, "mlx_cache_bytes": 2903135650, "process_rss_bytes": 297451520}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6448586980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "eb4d9d05bd93beebadeb0b446aca6f8cd3f69a85009c57c2686509661e53bad1", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 135 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0979bdfd41adddd70a3c17ae", "attempt_id": "ad0d6612c826", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:22.441259Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6321692680}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": "5934e1e7b2bd92f6", "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112744, "side_information_bytes": 16104, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.612625017762184, "doc_prefill_ms": 978.4983330173418, "compress_ms": 2.880375017412007, "serialize_ms": 26.52341697830707, "load_ms": 13.400583993643522, "receiver_prefill_ms": 0.0, "query_prefill_ms": 112.01254196930677, "ttft_ms": 112.01254196930677, "decode_ms": 404.5315410476178}, "total_wall_ms": 531.9922911003232, "ttft_ms": 112.01254196930677, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 297467904, "backend_memory": {"mlx_active_bytes": 6398369800, "mlx_peak_bytes": 6454108408, "mlx_cache_bytes": 2903135650, "process_rss_bytes": 297467904}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6454108408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6889172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "eb4d9d05bd93beebadeb0b446aca6f8cd3f69a85009c57c2686509661e53bad1", "output_hash": "adcb8d196080006451756ad2fe2106d5a1b6500c0f76ffaa05d7fe704243ad3b"} | |
| 136 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d332386db6784efc64c1d901", "attempt_id": "89423c9b6067", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:23.079020Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6287439112}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 39363840, "serialized_payload_bytes": 39398030, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 81.0227079782635, "doc_prefill_ms": 978.4983330173418, "compress_ms": 62.38841696176678, "serialize_ms": 17.83695793710649, "load_ms": 10.063333087600768, "receiver_prefill_ms": 0.0, "query_prefill_ms": 98.01379207056016, "ttft_ms": 98.01379207056016, "decode_ms": 642.7352499449626}, "total_wall_ms": 752.6289579691365, "ttft_ms": 98.01379207056016, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 35}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 344621056, "backend_memory": {"mlx_active_bytes": 6331086088, "mlx_peak_bytes": 6385244376, "mlx_cache_bytes": 3107838578, "process_rss_bytes": 344621056}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6385244376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "5f8624f35d651cd19bdb054c3205083465b76bee66103dc2a4d23dbd2e6dc167", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 137 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ce8c36602a602b283ae79103", "attempt_id": "d5a56b03124d", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:23.856723Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6287439112}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 39363840, "serialized_payload_bytes": 39398030, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 81.0227079782635, "doc_prefill_ms": 978.4983330173418, "compress_ms": 62.38841696176678, "serialize_ms": 17.83695793710649, "load_ms": 1.7602919833734632, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.62908299546689, "ttft_ms": 73.62908299546689, "decode_ms": 581.0134579660371}, "total_wall_ms": 658.16533297766, "ttft_ms": 73.62908299546689, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 344866816, "backend_memory": {"mlx_active_bytes": 6331086088, "mlx_peak_bytes": 6397341488, "mlx_cache_bytes": 3132174722, "process_rss_bytes": 344866816}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6397341488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "5f8624f35d651cd19bdb054c3205083465b76bee66103dc2a4d23dbd2e6dc167", "output_hash": "b6582a041b3d2b38ac6924099568ca2e6f1a610c6fb5f4de2e0516b90433bc2a"} | |
| 138 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6dadda20b29533e19a33cf18", "attempt_id": "e7f2c16a7620", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:24.537804Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6287439112}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 39363840, "serialized_payload_bytes": 39398030, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 81.0227079782635, "doc_prefill_ms": 978.4983330173418, "compress_ms": 62.38841696176678, "serialize_ms": 17.83695793710649, "load_ms": 4.641667008399963, "receiver_prefill_ms": 0.0, "query_prefill_ms": 87.89008401799947, "ttft_ms": 87.89008401799947, "decode_ms": 413.85362506844103}, "total_wall_ms": 508.1339169992134, "ttft_ms": 87.89008401799947, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 344883200, "backend_memory": {"mlx_active_bytes": 6331086088, "mlx_peak_bytes": 6397342960, "mlx_cache_bytes": 3132174722, "process_rss_bytes": 344883200}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6397342960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "5f8624f35d651cd19bdb054c3205083465b76bee66103dc2a4d23dbd2e6dc167", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 139 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e700fa2d22c5d68a0eff00a3", "attempt_id": "ece0de4ceb84", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:25.069353Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6287439112}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 39363840, "serialized_payload_bytes": 39398030, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 81.0227079782635, "doc_prefill_ms": 978.4983330173418, "compress_ms": 62.38841696176678, "serialize_ms": 17.83695793710649, "load_ms": 3.1166670378297567, "receiver_prefill_ms": 0.0, "query_prefill_ms": 223.1630829628557, "ttft_ms": 223.1630829628557, "decode_ms": 311.76733307074755}, "total_wall_ms": 539.6941249491647, "ttft_ms": 223.1630829628557, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 38}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 345047040, "backend_memory": {"mlx_active_bytes": 6331086088, "mlx_peak_bytes": 6391805168, "mlx_cache_bytes": 3156226434, "process_rss_bytes": 345047040}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6391805168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "5f8624f35d651cd19bdb054c3205083465b76bee66103dc2a4d23dbd2e6dc167", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 140 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a5acf6de255115fd7dc04e29", "attempt_id": "385f04d3e231", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:25.632423Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6287439112}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 39363840, "serialized_payload_bytes": 39398030, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 81.0227079782635, "doc_prefill_ms": 978.4983330173418, "compress_ms": 62.38841696176678, "serialize_ms": 17.83695793710649, "load_ms": 2.546416944824159, "receiver_prefill_ms": 0.0, "query_prefill_ms": 79.18208301998675, "ttft_ms": 79.18208301998675, "decode_ms": 429.49112493079156}, "total_wall_ms": 512.9653329495341, "ttft_ms": 79.18208301998675, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 345063424, "backend_memory": {"mlx_active_bytes": 6331086088, "mlx_peak_bytes": 6403224084, "mlx_cache_bytes": 3184888674, "process_rss_bytes": 345063424}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6403224084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6889172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "5f8624f35d651cd19bdb054c3205083465b76bee66103dc2a4d23dbd2e6dc167", "output_hash": "adcb8d196080006451756ad2fe2106d5a1b6500c0f76ffaa05d7fe704243ad3b"} | |
| 141 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7cd936a2450994b0faf02135", "attempt_id": "491b7b0c189d", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:26.238317Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6268564744}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 20839680, "serialized_payload_bytes": 20873736, "side_information_bytes": 34056, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 67.32925004325807, "doc_prefill_ms": 978.4983330173418, "compress_ms": 55.0057920627296, "serialize_ms": 11.838207952678204, "load_ms": 4.002374946139753, "receiver_prefill_ms": 0.0, "query_prefill_ms": 67.90645804721862, "ttft_ms": 67.90645804721862, "decode_ms": 2813.5319590801373}, "total_wall_ms": 2887.6000830205157, "ttft_ms": 67.90645804721862, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 366903296, "backend_memory": {"mlx_active_bytes": 6293337352, "mlx_peak_bytes": 6343993640, "mlx_cache_bytes": 3290173922, "process_rss_bytes": 366903296}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6343993640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\n\nunknownunknownunknown memo\n\n5\nunknown memo\n5\n\n\n memo memo memo memo memo memo memo memo memo memo memo memo memo memo memo memo memo memo memo memo memo memo memo memo memo memo memo memo memo memo", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "76d58caa4868c5c31b8703292423da4d64fc4061ef7af423b7b0c2b1f80e4f14", "output_hash": "78d55bf7eaf8f5d5718fae1592c5390a9d4187e68a847a5372b8f5fb9e43768c"} | |
| 142 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "94492e56572670a9559d73c6", "attempt_id": "f59fbcc64611", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:29.153268Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6268564744}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 20839680, "serialized_payload_bytes": 20873736, "side_information_bytes": 34056, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 67.32925004325807, "doc_prefill_ms": 978.4983330173418, "compress_ms": 55.0057920627296, "serialize_ms": 11.838207952678204, "load_ms": 3.526707994751632, "receiver_prefill_ms": 0.0, "query_prefill_ms": 80.7841670466587, "ttft_ms": 80.7841670466587, "decode_ms": 2763.325000065379}, "total_wall_ms": 2849.4511670432985, "ttft_ms": 80.7841670466587, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 367132672, "backend_memory": {"mlx_active_bytes": 6293337352, "mlx_peak_bytes": 6355811184, "mlx_cache_bytes": 3290173922, "process_rss_bytes": 367132672}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6355811184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": " \nuser\n\n memo20.\nat000000000 of000000000000000000000000 of000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "76d58caa4868c5c31b8703292423da4d64fc4061ef7af423b7b0c2b1f80e4f14", "output_hash": "f956396894d647df89bc96127bf3812773aa370217fc6449ccdda4300087a89f"} | |
| 143 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "853a5b240bffe439cd749368", "attempt_id": "04c8da66ebbb", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:32.028236Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6268564744}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 20839680, "serialized_payload_bytes": 20873736, "side_information_bytes": 34056, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 67.32925004325807, "doc_prefill_ms": 978.4983330173418, "compress_ms": 55.0057920627296, "serialize_ms": 11.838207952678204, "load_ms": 6.513500004075468, "receiver_prefill_ms": 0.0, "query_prefill_ms": 62.48629197943956, "ttft_ms": 62.48629197943956, "decode_ms": 106.45483306143433}, "total_wall_ms": 177.16833390295506, "ttft_ms": 62.48629197943956, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 367230976, "backend_memory": {"mlx_active_bytes": 6293337352, "mlx_peak_bytes": 6355811184, "mlx_cache_bytes": 3290173922, "process_rss_bytes": 367230976}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6355811184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\n\n", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "invalid_output", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "76d58caa4868c5c31b8703292423da4d64fc4061ef7af423b7b0c2b1f80e4f14", "output_hash": "75a11da44c802486bc6f65640aa48a730f0f684c5c07a42ba3cd1735eb3fb070"} | |
| 144 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "81f140027c0a997402ce4f2e", "attempt_id": "7f67524fc3a1", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:32.229035Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6268564744}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 20839680, "serialized_payload_bytes": 20873736, "side_information_bytes": 34056, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 67.32925004325807, "doc_prefill_ms": 978.4983330173418, "compress_ms": 55.0057920627296, "serialize_ms": 11.838207952678204, "load_ms": 5.260500009171665, "receiver_prefill_ms": 0.0, "query_prefill_ms": 190.32929092645645, "ttft_ms": 190.32929092645645, "decode_ms": 2674.499708926305}, "total_wall_ms": 2871.8064579879865, "ttft_ms": 190.32929092645645, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 38}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 367476736, "backend_memory": {"mlx_active_bytes": 6293337352, "mlx_peak_bytes": 6351125360, "mlx_cache_bytes": 3290173922, "process_rss_bytes": 367476736}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6351125360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "user\n\nsystem 0 0 000000000000000000000000000000000000000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "76d58caa4868c5c31b8703292423da4d64fc4061ef7af423b7b0c2b1f80e4f14", "output_hash": "d3da647a46cbd3eb57b7ba22bfc90fff80e5d0dfb8efe06d0ea15bf1b7249bde"} | |
| 145 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a72bd27a56291013f5fe2876", "attempt_id": "e5a7713892f4", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:35.125847Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6268564744}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 20839680, "serialized_payload_bytes": 20873736, "side_information_bytes": 34056, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 67.32925004325807, "doc_prefill_ms": 978.4983330173418, "compress_ms": 55.0057920627296, "serialize_ms": 11.838207952678204, "load_ms": 3.285999991931021, "receiver_prefill_ms": 0.0, "query_prefill_ms": 82.0221669273451, "ttft_ms": 82.0221669273451, "decode_ms": 2893.6651669209823}, "total_wall_ms": 2980.708874994889, "ttft_ms": 82.0221669273451, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 367493120, "backend_memory": {"mlx_active_bytes": 6293337352, "mlx_peak_bytes": 6361696052, "mlx_cache_bytes": 3290173922, "process_rss_bytes": 367493120}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6361696052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\n\n\n\n\n\n\n\n\n1 5 4 0 2 2 2 2 \n the the the the the the the the the the the the the the", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "76d58caa4868c5c31b8703292423da4d64fc4061ef7af423b7b0c2b1f80e4f14", "output_hash": "e8bbb8477ac2e890e7a22ce3d59d8e25dde723ba6f783fb1cd5c1e25d71bd090"} | |
| 146 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5824d534bcfbd72198cf99b4", "attempt_id": "56c5a44010c0", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:38.201954Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6262415368}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 13893120, "serialized_payload_bytes": 13926962, "side_information_bytes": 33842, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 70.37537498399615, "doc_prefill_ms": 978.4983330173418, "compress_ms": 56.51024996768683, "serialize_ms": 13.307290966622531, "load_ms": 3.6454590735957026, "receiver_prefill_ms": 0.0, "query_prefill_ms": 251.5014170203358, "ttft_ms": 251.5014170203358, "decode_ms": 2870.899665984325}, "total_wall_ms": 3129.833917017095, "ttft_ms": 251.5014170203358, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 379731968, "backend_memory": {"mlx_active_bytes": 6280634376, "mlx_peak_bytes": 6329204264, "mlx_cache_bytes": 3336158306, "process_rss_bytes": 379731968}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6329204264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "eso\nñailed in the project the later the\nThe-he is 1hehehe the the hee short Health Health Health Health Health Health Health Health Health Health Health Health Health Health Health Health Health Health Health Health Health Health Health", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7960b1fa79fbc02499ce6229a9a9eec92f86bde6fcca0fb9a9948b61cba15e6f", "output_hash": "ffe9e1c526a82a08613608e4c4f218dff9d7359341ef3b519fc07c5035dcc421"} | |
| 147 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "41f2163c35c44d7c549109a9", "attempt_id": "0c3331abb4c3", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:41.358257Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6262415368}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 13893120, "serialized_payload_bytes": 13926962, "side_information_bytes": 33842, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 70.37537498399615, "doc_prefill_ms": 978.4983330173418, "compress_ms": 56.51024996768683, "serialize_ms": 13.307290966622531, "load_ms": 4.8314169980585575, "receiver_prefill_ms": 0.0, "query_prefill_ms": 80.85762499831617, "ttft_ms": 80.85762499831617, "decode_ms": 2783.167792018503}, "total_wall_ms": 2870.5562920076773, "ttft_ms": 80.85762499831617, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 379961344, "backend_memory": {"mlx_active_bytes": 6280634376, "mlx_peak_bytes": 6341282553, "mlx_cache_bytes": 3336182947, "process_rss_bytes": 379961344}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6341282553, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": " \n\n0\n2\n2\n2\n2\n2\n2\n\n0\n4\n of the of the of the of the of the of the of the of the of the of the of the of the the of the", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7960b1fa79fbc02499ce6229a9a9eec92f86bde6fcca0fb9a9948b61cba15e6f", "output_hash": "c1ca748f56503d4863f9966df300c79baf9d9456236b1cf2950e04720a719536"} | |
| 148 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0854d0e9d9ef7715ad3b0bb0", "attempt_id": "b06d89430872", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:44.253780Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6262415368}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 13893120, "serialized_payload_bytes": 13926962, "side_information_bytes": 33842, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 70.37537498399615, "doc_prefill_ms": 978.4983330173418, "compress_ms": 56.51024996768683, "serialize_ms": 13.307290966622531, "load_ms": 3.1506670638918877, "receiver_prefill_ms": 0.0, "query_prefill_ms": 56.85079097747803, "ttft_ms": 56.85079097747803, "decode_ms": 124.23537496943027}, "total_wall_ms": 186.32574996445328, "ttft_ms": 56.85079097747803, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 379977728, "backend_memory": {"mlx_active_bytes": 6280634376, "mlx_peak_bytes": 6341282553, "mlx_cache_bytes": 3336182947, "process_rss_bytes": 379977728}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6341282553, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\n\n", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "invalid_output", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7960b1fa79fbc02499ce6229a9a9eec92f86bde6fcca0fb9a9948b61cba15e6f", "output_hash": "75a11da44c802486bc6f65640aa48a730f0f684c5c07a42ba3cd1735eb3fb070"} | |
| 149 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "506735b3474049ef8420f0fa", "attempt_id": "532b2e922f2f", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:44.466503Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6262415368}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 13893120, "serialized_payload_bytes": 13926962, "side_information_bytes": 33842, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 70.37537498399615, "doc_prefill_ms": 978.4983330173418, "compress_ms": 56.51024996768683, "serialize_ms": 13.307290966622531, "load_ms": 3.502874984405935, "receiver_prefill_ms": 0.0, "query_prefill_ms": 208.85612501297146, "ttft_ms": 208.85612501297146, "decode_ms": 499.93570894002914}, "total_wall_ms": 714.4639589823782, "ttft_ms": 208.85612501297146, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 38}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 380092416, "backend_memory": {"mlx_active_bytes": 6280634376, "mlx_peak_bytes": 6336366736, "mlx_cache_bytes": 3336347395, "process_rss_bytes": 380092416}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6336366736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\n.\nenu0\n8.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7960b1fa79fbc02499ce6229a9a9eec92f86bde6fcca0fb9a9948b61cba15e6f", "output_hash": "0712057767b5231d8d43eb26fba1f7d44ff199739806ef7cef86faba42ba8c89"} | |
| 150 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5cad66430628f529c1447990", "attempt_id": "25eef9c792e9", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:45.206545Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6262415368}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 13893120, "serialized_payload_bytes": 13926962, "side_information_bytes": 33842, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 70.37537498399615, "doc_prefill_ms": 978.4983330173418, "compress_ms": 56.51024996768683, "serialize_ms": 13.307290966622531, "load_ms": 3.1956250313669443, "receiver_prefill_ms": 0.0, "query_prefill_ms": 82.27187499869615, "ttft_ms": 82.27187499869615, "decode_ms": 2853.5520839504898}, "total_wall_ms": 2941.789541975595, "ttft_ms": 82.27187499869615, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 380174336, "backend_memory": {"mlx_active_bytes": 6280634376, "mlx_peak_bytes": 6347167297, "mlx_cache_bytes": 3336372419, "process_rss_bytes": 380174336}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6347167297, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": " To()\ntoto\n\nto\ntoo\n\nto\n\nto\nto 11 10 0 1 0 0 0 0 000 ", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7960b1fa79fbc02499ce6229a9a9eec92f86bde6fcca0fb9a9948b61cba15e6f", "output_hash": "5c0fdcb95957f5817db3ee6259a246493e82fb3dbc571cdbe5b9e1fc64507105"} | |
| 151 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "45449d4dadf2ca7f494fb1c1", "attempt_id": "cf7d26ec9c79", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:48.276243Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6285123592}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 2010, "keep": 1005, "compress_ms": 80.88529098313302}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 37048320, "serialized_payload_bytes": 37064494, "side_information_bytes": 16174, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 103.52700005751103, "doc_prefill_ms": 978.4983330173418, "compress_ms": 80.96541708800942, "serialize_ms": 22.373708081431687, "load_ms": 1.7549169715493917, "receiver_prefill_ms": 0.0, "query_prefill_ms": 66.08933303505182, "ttft_ms": 66.08933303505182, "decode_ms": 104.69000006560236}, "total_wall_ms": 174.91079203318805, "ttft_ms": 66.08933303505182, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 35}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 391757824, "backend_memory": {"mlx_active_bytes": 6324051976, "mlx_peak_bytes": 6363029708, "mlx_cache_bytes": 3292954819, "process_rss_bytes": 391757824}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6363029708, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not provided", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "17d15600096a15c4e1adfeb19b160a6cab5f5501a89db769a2c4e0577f8edbc5", "output_hash": "d83b9ff3c07a8390e2ea0a2af45fba37595da25f31b85ba625363ee98c0c796f"} | |
| 152 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "874a877b8fc70e6daa01ddbe", "attempt_id": "aa03ce999f06", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:48.475586Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6285123592}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 2010, "keep": 1005, "compress_ms": 80.88529098313302}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 37048320, "serialized_payload_bytes": 37064494, "side_information_bytes": 16174, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 103.52700005751103, "doc_prefill_ms": 978.4983330173418, "compress_ms": 80.96541708800942, "serialize_ms": 22.373708081431687, "load_ms": 1.1513339122757316, "receiver_prefill_ms": 0.0, "query_prefill_ms": 65.51987503189594, "ttft_ms": 65.51987503189594, "decode_ms": 501.2499999720603}, "total_wall_ms": 569.7316660080105, "ttft_ms": 65.51987503189594, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 391757824, "backend_memory": {"mlx_active_bytes": 6324051976, "mlx_peak_bytes": 6369239268, "mlx_cache_bytes": 3292954819, "process_rss_bytes": 391757824}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6369239268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "17d15600096a15c4e1adfeb19b160a6cab5f5501a89db769a2c4e0577f8edbc5", "output_hash": "b6582a041b3d2b38ac6924099568ca2e6f1a610c6fb5f4de2e0516b90433bc2a"} | |
| 153 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0bd9a0f0bf57a1aebfe6b976", "attempt_id": "5cd68886b63f", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:49.070240Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6285123592}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 2010, "keep": 1005, "compress_ms": 80.88529098313302}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 37048320, "serialized_payload_bytes": 37064494, "side_information_bytes": 16174, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 103.52700005751103, "doc_prefill_ms": 978.4983330173418, "compress_ms": 80.96541708800942, "serialize_ms": 22.373708081431687, "load_ms": 1.1686249636113644, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.905416999943554, "ttft_ms": 51.905416999943554, "decode_ms": 385.2078339550644}, "total_wall_ms": 440.02754206303507, "ttft_ms": 51.905416999943554, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 391790592, "backend_memory": {"mlx_active_bytes": 6324051976, "mlx_peak_bytes": 6369239268, "mlx_cache_bytes": 3292954819, "process_rss_bytes": 391790592}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6369239268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "17d15600096a15c4e1adfeb19b160a6cab5f5501a89db769a2c4e0577f8edbc5", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 154 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8ac4718d4962b7af41d1be8e", "attempt_id": "ec2f80111d8b", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:49.534245Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6285123592}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 2010, "keep": 1005, "compress_ms": 80.88529098313302}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 37048320, "serialized_payload_bytes": 37064494, "side_information_bytes": 16174, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 103.52700005751103, "doc_prefill_ms": 978.4983330173418, "compress_ms": 80.96541708800942, "serialize_ms": 22.373708081431687, "load_ms": 1.8943339819088578, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.95041699055582, "ttft_ms": 73.95041699055582, "decode_ms": 264.9809579597786}, "total_wall_ms": 342.73837495129555, "ttft_ms": 73.95041699055582, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 38}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 391790592, "backend_memory": {"mlx_active_bytes": 6324051976, "mlx_peak_bytes": 6368223460, "mlx_cache_bytes": 3292954819, "process_rss_bytes": 391790592}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6368223460, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "17d15600096a15c4e1adfeb19b160a6cab5f5501a89db769a2c4e0577f8edbc5", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 155 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4b8380cb52bc8ff97b46c252", "attempt_id": "da668159a6fa", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:49.906444Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6285123592}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 2010, "keep": 1005, "compress_ms": 80.88529098313302}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 37048320, "serialized_payload_bytes": 37064494, "side_information_bytes": 16174, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 103.52700005751103, "doc_prefill_ms": 978.4983330173418, "compress_ms": 80.96541708800942, "serialize_ms": 22.373708081431687, "load_ms": 6.182792014442384, "receiver_prefill_ms": 0.0, "query_prefill_ms": 64.67024993617088, "ttft_ms": 64.67024993617088, "decode_ms": 362.70954203791916}, "total_wall_ms": 435.4581250809133, "ttft_ms": 64.67024993617088, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 391872512, "backend_memory": {"mlx_active_bytes": 6325231624, "mlx_peak_bytes": 6372630776, "mlx_cache_bytes": 3341910211, "process_rss_bytes": 391872512}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6372630776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7354655", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "17d15600096a15c4e1adfeb19b160a6cab5f5501a89db769a2c4e0577f8edbc5", "output_hash": "8d148a11998d8f65810559f1ef4ae6479852ba925e986cd71d6da7e4a8e315fb"} | |
| 156 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1e0880ce4166762fa73a7056", "attempt_id": "16f7dd0ee112", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:50.431274Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 2010, "keep": 502, "compress_ms": 47.57491697091609}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521645, "side_information_bytes": 15917, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 60.686292010359466, "doc_prefill_ms": 978.4983330173418, "compress_ms": 47.63674992136657, "serialize_ms": 12.81133305747062, "load_ms": 1.2637079926207662, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.25625000987202, "ttft_ms": 78.25625000987202, "decode_ms": 410.6784160248935}, "total_wall_ms": 491.99295800644904, "ttft_ms": 78.25625000987202, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 35}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 415449088, "backend_memory": {"mlx_active_bytes": 6287548424, "mlx_peak_bytes": 6321594572, "mlx_cache_bytes": 3406203035, "process_rss_bytes": 415449088}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6321594572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "MP-89X-6320", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7f6ef81007573cfaec410eb9847c70ee516bcb552b3345400893355ca501b96b", "output_hash": "e07259f8346a7570e5b980e01a868e6af8ede517e6d7f6a2958e2f3b8da08023"} | |
| 157 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "53d8f50534dd727bbd148b91", "attempt_id": "054cfe16836b", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:50.947421Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 2010, "keep": 502, "compress_ms": 47.57491697091609}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521645, "side_information_bytes": 15917, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 60.686292010359466, "doc_prefill_ms": 978.4983330173418, "compress_ms": 47.63674992136657, "serialize_ms": 12.81133305747062, "load_ms": 1.2311659520491958, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.247791019268334, "ttft_ms": 31.247791019268334, "decode_ms": 361.6451659472659}, "total_wall_ms": 396.09987498261034, "ttft_ms": 31.247791019268334, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 415481856, "backend_memory": {"mlx_active_bytes": 6287548424, "mlx_peak_bytes": 6327804132, "mlx_cache_bytes": 3406203035, "process_rss_bytes": 415481856}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6327804132, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7f6ef81007573cfaec410eb9847c70ee516bcb552b3345400893355ca501b96b", "output_hash": "b6582a041b3d2b38ac6924099568ca2e6f1a610c6fb5f4de2e0516b90433bc2a"} | |
| 158 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "63c86e53f1a9da4ee1453a9d", "attempt_id": "d2bbbec71c5c", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:51.367094Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 2010, "keep": 502, "compress_ms": 47.57491697091609}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521645, "side_information_bytes": 15917, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 60.686292010359466, "doc_prefill_ms": 978.4983330173418, "compress_ms": 47.63674992136657, "serialize_ms": 12.81133305747062, "load_ms": 2.270334050990641, "receiver_prefill_ms": 0.0, "query_prefill_ms": 54.82562503311783, "ttft_ms": 54.82562503311783, "decode_ms": 98.71366701554507}, "total_wall_ms": 157.672708039172, "ttft_ms": 54.82562503311783, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 415498240, "backend_memory": {"mlx_active_bytes": 6287482888, "mlx_peak_bytes": 6327804132, "mlx_cache_bytes": 3406268571, "process_rss_bytes": 415498240}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6327804132, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not provided", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7f6ef81007573cfaec410eb9847c70ee516bcb552b3345400893355ca501b96b", "output_hash": "d83b9ff3c07a8390e2ea0a2af45fba37595da25f31b85ba625363ee98c0c796f"} | |
| 159 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2f15871722d1aef492ba94a7", "attempt_id": "3b1765607a66", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:51.551640Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 2010, "keep": 502, "compress_ms": 47.57491697091609}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521645, "side_information_bytes": 15917, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 60.686292010359466, "doc_prefill_ms": 978.4983330173418, "compress_ms": 47.63674992136657, "serialize_ms": 12.81133305747062, "load_ms": 1.915832981467247, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.56808397825807, "ttft_ms": 52.56808397825807, "decode_ms": 114.58470893558115}, "total_wall_ms": 171.09187494497746, "ttft_ms": 52.56808397825807, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 38}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 415531008, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6326788324, "mlx_cache_bytes": 3407448219, "process_rss_bytes": 415531008}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6326788324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Milos Ferrante", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7f6ef81007573cfaec410eb9847c70ee516bcb552b3345400893355ca501b96b", "output_hash": "14ae3adaefbe5d307a9585834a37951eb0794dc1bfacd0739a580886526143d2"} | |
| 160 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7b5d7a113122635eb04bccbe", "attempt_id": "86520a116129", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:51.746736Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 2010, "keep": 502, "compress_ms": 47.57491697091609}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521645, "side_information_bytes": 15917, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 60.686292010359466, "doc_prefill_ms": 978.4983330173418, "compress_ms": 47.63674992136657, "serialize_ms": 12.81133305747062, "load_ms": 1.3356669805943966, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.01012496743351, "ttft_ms": 51.01012496743351, "decode_ms": 254.03487496078014}, "total_wall_ms": 308.31062502693385, "ttft_ms": 51.01012496743351, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 46}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 415531008, "backend_memory": {"mlx_active_bytes": 6287548424, "mlx_peak_bytes": 6332375288, "mlx_cache_bytes": 3406203035, "process_rss_bytes": 415531008}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6332375288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "120000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7f6ef81007573cfaec410eb9847c70ee516bcb552b3345400893355ca501b96b", "output_hash": "4f9f73b34c5b89879aad65a48025f3187dd9ce6dc3d4e88eecb2fc79227350f1"} | |
| 161 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "def178164103808ffb24b221", "attempt_id": "0fdd6ec712c9", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:52.129712Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6256812040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 2010, "keep": 251, "compress_ms": 41.31716606207192}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 9252864, "serialized_payload_bytes": 9268708, "side_information_bytes": 15844, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.348666936159134, "doc_prefill_ms": 978.4983330173418, "compress_ms": 41.36320808902383, "serialize_ms": 5.754875019192696, "load_ms": 1.6183329280465841, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.33358305040747, "ttft_ms": 48.33358305040747, "decode_ms": 421.7722500907257}, "total_wall_ms": 473.82229194045067, "ttft_ms": 48.33358305040747, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 35}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 419807232, "backend_memory": {"mlx_active_bytes": 6269329416, "mlx_peak_bytes": 6301605788, "mlx_cache_bytes": 3424749723, "process_rss_bytes": 419807232}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6301605788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "MP-89X-6320", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "55f4e09494fa3cefd3b5233346303ec551b5e3340638f269e7a42ddf548197cf", "output_hash": "e07259f8346a7570e5b980e01a868e6af8ede517e6d7f6a2958e2f3b8da08023"} | |
| 162 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ce78979af3b845da8fc9d33a", "attempt_id": "7689c26ad116", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:52.628211Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6256812040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 2010, "keep": 251, "compress_ms": 41.31716606207192}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 9252864, "serialized_payload_bytes": 9268708, "side_information_bytes": 15844, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.348666936159134, "doc_prefill_ms": 978.4983330173418, "compress_ms": 41.36320808902383, "serialize_ms": 5.754875019192696, "load_ms": 1.2893329840153456, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.5941249076277, "ttft_ms": 37.5941249076277, "decode_ms": 300.26895890478045}, "total_wall_ms": 340.8969999291003, "ttft_ms": 37.5941249076277, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 419840000, "backend_memory": {"mlx_active_bytes": 6269296648, "mlx_peak_bytes": 6309404596, "mlx_cache_bytes": 3428059291, "process_rss_bytes": 419840000}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6309404596, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "55f4e09494fa3cefd3b5233346303ec551b5e3340638f269e7a42ddf548197cf", "output_hash": "b6582a041b3d2b38ac6924099568ca2e6f1a610c6fb5f4de2e0516b90433bc2a"} | |
| 163 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0198af13b1129c2e71e5a668", "attempt_id": "6eb56a3cac72", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:52.992584Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6256812040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 2010, "keep": 251, "compress_ms": 41.31716606207192}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 9252864, "serialized_payload_bytes": 9268708, "side_information_bytes": 15844, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.348666936159134, "doc_prefill_ms": 978.4983330173418, "compress_ms": 41.36320808902383, "serialize_ms": 5.754875019192696, "load_ms": 1.2312500039115548, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.74345795158297, "ttft_ms": 47.74345795158297, "decode_ms": 84.82758305035532}, "total_wall_ms": 135.71087492164224, "ttft_ms": 47.74345795158297, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 419840000, "backend_memory": {"mlx_active_bytes": 6269083656, "mlx_peak_bytes": 6308945844, "mlx_cache_bytes": 3429746843, "process_rss_bytes": 419840000}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6308945844, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not provided", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "55f4e09494fa3cefd3b5233346303ec551b5e3340638f269e7a42ddf548197cf", "output_hash": "d83b9ff3c07a8390e2ea0a2af45fba37595da25f31b85ba625363ee98c0c796f"} | |
| 164 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8e7267c6b703784866e0b8ef", "attempt_id": "7ed61cb6de64", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:53.153119Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6256812040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 2010, "keep": 251, "compress_ms": 41.31716606207192}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 9252864, "serialized_payload_bytes": 9268708, "side_information_bytes": 15844, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.348666936159134, "doc_prefill_ms": 978.4983330173418, "compress_ms": 41.36320808902383, "serialize_ms": 5.754875019192696, "load_ms": 2.68454197794199, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.02141589485109, "ttft_ms": 42.02141589485109, "decode_ms": 96.01737488992512}, "total_wall_ms": 142.68562500365078, "ttft_ms": 42.02141589485109, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 419889152, "backend_memory": {"mlx_active_bytes": 6268739592, "mlx_peak_bytes": 6306291636, "mlx_cache_bytes": 3433367707, "process_rss_bytes": 419889152}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6306291636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "John Doe", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "55f4e09494fa3cefd3b5233346303ec551b5e3340638f269e7a42ddf548197cf", "output_hash": "6cea57c2fb6cbc2a40411135005760f241fffc3e5e67ab99882726431037f908"} | |
| 165 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "06d010949bc01ca19ade1895", "attempt_id": "8220c61d5c46", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:53.321397Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6256812040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 2010, "keep": 251, "compress_ms": 41.31716606207192}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 9252864, "serialized_payload_bytes": 9268708, "side_information_bytes": 15844, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.348666936159134, "doc_prefill_ms": 978.4983330173418, "compress_ms": 41.36320808902383, "serialize_ms": 5.754875019192696, "load_ms": 1.3275420060381293, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.03954192902893, "ttft_ms": 48.03954192902893, "decode_ms": 218.25925004668534}, "total_wall_ms": 269.2964170128107, "ttft_ms": 48.03954192902893, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 46}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 419889152, "backend_memory": {"mlx_active_bytes": 6268821512, "mlx_peak_bytes": 6311649224, "mlx_cache_bytes": 3433285787, "process_rss_bytes": 419889152}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6311649224, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "500000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "55f4e09494fa3cefd3b5233346303ec551b5e3340638f269e7a42ddf548197cf", "output_hash": "8d6962a152aee235ba824c41758b8da2371b7077b4ea0afaaec94014e16e3bc7"} | |
| 166 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "05a7b029b6a4058f6b259ccc", "attempt_id": "a05fc52f44de", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:53.682878Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 2010, "keep": 502, "compress_ms": 57.059750077314675}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521641, "side_information_bytes": 15913, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 68.19895806256682, "doc_prefill_ms": 978.4983330173418, "compress_ms": 57.12962499819696, "serialize_ms": 10.83554106298834, "load_ms": 1.6067089745774865, "receiver_prefill_ms": 0.0, "query_prefill_ms": 40.13862495776266, "ttft_ms": 40.13862495776266, "decode_ms": 1860.7685409951955}, "total_wall_ms": 1904.3388329446316, "ttft_ms": 40.13862495776266, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 435650560, "backend_memory": {"mlx_active_bytes": 6288662536, "mlx_peak_bytes": 6321594572, "mlx_cache_bytes": 3439593627, "process_rss_bytes": 435650560}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6321594572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "assistant\n\nAssistant, Assistant, Assistant\n\nAssistant, Assistant, Assistant\n\nAssistant, Assistant, Assistant\n\nAssistant, Assistant, Assistant\n\nAssistant, Assistant, Assistant\n\nAssistant, Assistant, Assistant\n\nAssistant, Assistant, Assistant\n\nAssistant, Assistant,", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "febe22ff4556ec505bab21f2ebddecefa50d28e8b3bba2fcc597978e4f400e24", "output_hash": "a7f3f386f2ebe03f3097faba3f505d405d26b2f9abd5b6faacedc39b50901a2d"} | |
| 167 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "52ac8dc34857e9b2519ed43e", "attempt_id": "531c6105b4f0", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:55.609700Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 2010, "keep": 502, "compress_ms": 57.059750077314675}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521641, "side_information_bytes": 15913, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 68.19895806256682, "doc_prefill_ms": 978.4983330173418, "compress_ms": 57.12962499819696, "serialize_ms": 10.83554106298834, "load_ms": 2.5329169584438205, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.1832499653101, "ttft_ms": 52.1832499653101, "decode_ms": 1838.2992920232937}, "total_wall_ms": 1894.7905829409137, "ttft_ms": 52.1832499653101, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 435683328, "backend_memory": {"mlx_active_bytes": 6288662536, "mlx_peak_bytes": 6327804132, "mlx_cache_bytes": 3439593627, "process_rss_bytes": 435683328}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6327804132, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "I am a memo. I am a memo. I am a memo. I am a memo. I am a memo. I am a memo. I am a memo. I am a memo. I am a memo. I am a", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "febe22ff4556ec505bab21f2ebddecefa50d28e8b3bba2fcc597978e4f400e24", "output_hash": "426a0f227def734f39a983ae88dcd05e8dcbe992627914324fb637eb8cb63e6b"} | |
| 168 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "333c5a7b7e0a8e5455a49847", "attempt_id": "be34f0389e53", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:57.527494Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 2010, "keep": 502, "compress_ms": 57.059750077314675}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521641, "side_information_bytes": 15913, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 68.19895806256682, "doc_prefill_ms": 978.4983330173418, "compress_ms": 57.12962499819696, "serialize_ms": 10.83554106298834, "load_ms": 3.0611660331487656, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.79670807067305, "ttft_ms": 52.79670807067305, "decode_ms": 1919.1165410447866}, "total_wall_ms": 1977.272915886715, "ttft_ms": 52.79670807067305, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 435716096, "backend_memory": {"mlx_active_bytes": 6288662536, "mlx_peak_bytes": 6327804132, "mlx_cache_bytes": 3439593627, "process_rss_bytes": 435716096}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6327804132, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "The Project codes are the name name name name name name name name name name name name name name name name name name name name name name name name name name name name name name name name name name name name name name name name name name name", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "febe22ff4556ec505bab21f2ebddecefa50d28e8b3bba2fcc597978e4f400e24", "output_hash": "79576cc33fa68a3208636b2d8810c8c0d1f2117032776dc346a524e04fb85a25"} | |
| 169 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8bac4567a99d3b11349b3c4d", "attempt_id": "b42e3cb96243", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:59:59.530821Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 2010, "keep": 502, "compress_ms": 57.059750077314675}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521641, "side_information_bytes": 15913, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 68.19895806256682, "doc_prefill_ms": 978.4983330173418, "compress_ms": 57.12962499819696, "serialize_ms": 10.83554106298834, "load_ms": 2.693540998734534, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.54070806968957, "ttft_ms": 44.54070806968957, "decode_ms": 1905.63195804134}, "total_wall_ms": 1955.128541099839, "ttft_ms": 44.54070806968957, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 38}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 435765248, "backend_memory": {"mlx_active_bytes": 6288662536, "mlx_peak_bytes": 6324396260, "mlx_cache_bytes": 3439593627, "process_rss_bytes": 435765248}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6324396260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "I will revise the project.\nI will revise the project.\nI will revise the project.\nI will revise the project.\nI will revise the project.\nI will revise the project.\nI will revise the project.\nI will revise the project.\n", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "febe22ff4556ec505bab21f2ebddecefa50d28e8b3bba2fcc597978e4f400e24", "output_hash": "ec85516726e09bae04746f5b6be22f47099830d26c5193e069713a8e4b00dca5"} | |
| 170 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "40ce8ee2cc459e53d432ac9b", "attempt_id": "c31b11fcc433", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:01.509515Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 2010, "keep": 502, "compress_ms": 57.059750077314675}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521641, "side_information_bytes": 15913, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 68.19895806256682, "doc_prefill_ms": 978.4983330173418, "compress_ms": 57.12962499819696, "serialize_ms": 10.83554106298834, "load_ms": 1.6787908971309662, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.12537502683699, "ttft_ms": 35.12537502683699, "decode_ms": 1861.2989590037614}, "total_wall_ms": 1900.1809590263292, "ttft_ms": 35.12537502683699, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 435765248, "backend_memory": {"mlx_active_bytes": 6288662536, "mlx_peak_bytes": 6332375288, "mlx_cache_bytes": 3439593627, "process_rss_bytes": 435765248}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6332375288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "The Project Torsel-111111111111111111111111111111111111111111", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "febe22ff4556ec505bab21f2ebddecefa50d28e8b3bba2fcc597978e4f400e24", "output_hash": "507026f6b067a372cc62e223c8f35d069220ce4324d41766c0e2fb2fee2e3554"} | |
| 171 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3303177bc121ddf9c61342b0", "attempt_id": "d2bf00d69e03", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:03.435298Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 2010, "keep": 1005, "window_tokens": 35, "compress_ms": 131.71937502920628}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 37048320, "serialized_payload_bytes": 37064535, "side_information_bytes": 16215, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 149.07495898660272, "doc_prefill_ms": 978.4983330173418, "compress_ms": 134.04241693206131, "serialize_ms": 14.688875060528517, "load_ms": 2.247416996397078, "receiver_prefill_ms": 0.0, "query_prefill_ms": 63.857041066512465, "ttft_ms": 63.857041066512465, "decode_ms": 163.83012500591576}, "total_wall_ms": 385.94475004356354, "ttft_ms": 63.857041066512465, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 35}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 450183168, "backend_memory": {"mlx_active_bytes": 6324051976, "mlx_peak_bytes": 6363029708, "mlx_cache_bytes": 3493365915, "process_rss_bytes": 450183168}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6363029708, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "91f86923cebcc9c4b68998c5f39e5039c9052204124a0962d5e4b3d2125e9404", "output_hash": "4507f73e53dc60cf2db0c66127c210e76c026e3a3f2cb327b372cd61793443d9"} | |
| 172 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2f4b217f1ef51bfcb90f707f", "attempt_id": "8a6a4ada194b", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:03.850169Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 2010, "keep": 1005, "window_tokens": 41, "compress_ms": 135.56512503419071}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 37048320, "serialized_payload_bytes": 37064535, "side_information_bytes": 16215, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 152.8303329832852, "doc_prefill_ms": 978.4983330173418, "compress_ms": 137.6165000256151, "serialize_ms": 14.900958980433643, "load_ms": 0.5778749473392963, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.181290961802006, "ttft_ms": 38.181290961802006, "decode_ms": 373.5233750194311}, "total_wall_ms": 567.1716249780729, "ttft_ms": 38.181290961802006, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 459767808, "backend_memory": {"mlx_active_bytes": 6324051976, "mlx_peak_bytes": 6368649444, "mlx_cache_bytes": 3502049435, "process_rss_bytes": 459767808}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6368649444, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "91f86923cebcc9c4b68998c5f39e5039c9052204124a0962d5e4b3d2125e9404", "output_hash": "b6582a041b3d2b38ac6924099568ca2e6f1a610c6fb5f4de2e0516b90433bc2a"} | |
| 173 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c876c85a9f2b61a3c8031170", "attempt_id": "b4113e430ef9", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:04.446646Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 2010, "keep": 1005, "window_tokens": 41, "compress_ms": 181.6300000064075}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 37048320, "serialized_payload_bytes": 37064534, "side_information_bytes": 16214, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 197.6571249542758, "doc_prefill_ms": 978.4983330173418, "compress_ms": 183.52724995929748, "serialize_ms": 13.731124927289784, "load_ms": 1.8607500242069364, "receiver_prefill_ms": 0.0, "query_prefill_ms": 55.253040976822376, "ttft_ms": 55.253040976822376, "decode_ms": 255.760750034824}, "total_wall_ms": 513.2913329871371, "ttft_ms": 55.253040976822376, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 478691328, "backend_memory": {"mlx_active_bytes": 6324051976, "mlx_peak_bytes": 6368649444, "mlx_cache_bytes": 3502049435, "process_rss_bytes": 478691328}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6368649444, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "4820105fb795b0f6f33d2f15ee475ab2efa4add51302a6e39353817db749e573", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 174 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "03dc480f0976181173edc584", "attempt_id": "df26328f822d", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:04.987402Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 2010, "keep": 1005, "window_tokens": 38, "compress_ms": 158.82058395072818}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 37048320, "serialized_payload_bytes": 37064535, "side_information_bytes": 16215, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 173.08904195670038, "doc_prefill_ms": 978.4983330173418, "compress_ms": 160.90166696812958, "serialize_ms": 11.821750085800886, "load_ms": 0.841250061057508, "receiver_prefill_ms": 0.0, "query_prefill_ms": 59.6971670165658, "ttft_ms": 59.6971670165658, "decode_ms": 168.02791599184275}, "total_wall_ms": 403.6270839860663, "ttft_ms": 59.6971670165658, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 38}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 478822400, "backend_memory": {"mlx_active_bytes": 6324051976, "mlx_peak_bytes": 6365831396, "mlx_cache_bytes": 3506948251, "process_rss_bytes": 478822400}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6365831396, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "91f86923cebcc9c4b68998c5f39e5039c9052204124a0962d5e4b3d2125e9404", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 175 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "111fbedca997903c677bda6d", "attempt_id": "ac76d9517767", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:05.419802Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 2010, "keep": 1005, "window_tokens": 46, "compress_ms": 174.6552080148831}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 37048320, "serialized_payload_bytes": 37064534, "side_information_bytes": 16214, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 188.59779089689255, "doc_prefill_ms": 978.4983330173418, "compress_ms": 176.50412500370294, "serialize_ms": 11.79779099766165, "load_ms": 2.6412499137222767, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.651041040197015, "ttft_ms": 44.651041040197015, "decode_ms": 262.3440419556573}, "total_wall_ms": 500.2535410458222, "ttft_ms": 44.651041040197015, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 46}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 479117312, "backend_memory": {"mlx_active_bytes": 6325231624, "mlx_peak_bytes": 6372630776, "mlx_cache_bytes": 3526445211, "process_rss_bytes": 479117312}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6372630776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "688172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "4820105fb795b0f6f33d2f15ee475ab2efa4add51302a6e39353817db749e573", "output_hash": "dfd43f8ddbe767bad909ada1437a79c0dbd36d9b33121c8a65a6b3eebf334586"} | |
| 176 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "80a96a5619533c79772081f4", "attempt_id": "156856afeea5", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:05.944797Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 35, "compress_ms": 143.22600001469254}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521686, "side_information_bytes": 15958, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 153.58562499750406, "doc_prefill_ms": 978.4983330173418, "compress_ms": 146.09579101670533, "serialize_ms": 7.035665912553668, "load_ms": 1.6515000024810433, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.96708307508379, "ttft_ms": 45.96708307508379, "decode_ms": 276.07845899183303}, "total_wall_ms": 479.32941594626755, "ttft_ms": 45.96708307508379, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 35}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 480608256, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6321594572, "mlx_cache_bytes": 3565373595, "process_rss_bytes": 480608256}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6321594572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-1482", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2133e2d8fb6fbe8bb2bc071e98a75ef68a33983b8f86299196b1d6fddcd4bf21", "output_hash": "f5e9a6d78321ae31e0a3bdeeaf8c39b796c1fc12a0a8896955e8c411f428367c"} | |
| 177 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9a66b7b6a85827a424502a1d", "attempt_id": "f95e1bf5622b", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:06.456285Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 41, "compress_ms": 103.93987502902746}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521686, "side_information_bytes": 15958, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 113.22887509595603, "doc_prefill_ms": 978.4983330173418, "compress_ms": 105.88241706136614, "serialize_ms": 7.026750012300909, "load_ms": 0.954542076215148, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.40387503057718, "ttft_ms": 37.40387503057718, "decode_ms": 384.2731670010835}, "total_wall_ms": 538.0691250320524, "ttft_ms": 37.40387503057718, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 480641024, "backend_memory": {"mlx_active_bytes": 6287548424, "mlx_peak_bytes": 6327214308, "mlx_cache_bytes": 3564128411, "process_rss_bytes": 480641024}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6327214308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2133e2d8fb6fbe8bb2bc071e98a75ef68a33983b8f86299196b1d6fddcd4bf21", "output_hash": "b6582a041b3d2b38ac6924099568ca2e6f1a610c6fb5f4de2e0516b90433bc2a"} | |
| 178 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e43a496a2698ce861355b218", "attempt_id": "b5655d8b8347", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:07.023641Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 41, "compress_ms": 133.6641670204699}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521685, "side_information_bytes": 15957, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 141.8685419484973, "doc_prefill_ms": 978.4983330173418, "compress_ms": 135.57112507987767, "serialize_ms": 5.908999941311777, "load_ms": 0.8796249749138951, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.09145793132484, "ttft_ms": 31.09145793132484, "decode_ms": 301.63462506607175}, "total_wall_ms": 477.33141598291695, "ttft_ms": 31.09145793132484, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 480641024, "backend_memory": {"mlx_active_bytes": 6287482888, "mlx_peak_bytes": 6327214308, "mlx_cache_bytes": 3564193947, "process_rss_bytes": 480641024}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6327214308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c45b4f30b880b0f5227d71d6f0c6992840fbb19374bbf7cfe2bdd05e112c7db5", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 179 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "998f9b86ffb98e798bf6d872", "attempt_id": "7aa253603792", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:07.527466Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 38, "compress_ms": 187.73520807735622}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521686, "side_information_bytes": 15958, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 202.1150829968974, "doc_prefill_ms": 978.4983330173418, "compress_ms": 189.45208296645433, "serialize_ms": 12.313249986618757, "load_ms": 1.4884580159559846, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.767624955624342, "ttft_ms": 20.767624955624342, "decode_ms": 187.98804108519107}, "total_wall_ms": 418.6952089658007, "ttft_ms": 20.767624955624342, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 38}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 481083392, "backend_memory": {"mlx_active_bytes": 6287482888, "mlx_peak_bytes": 6324396260, "mlx_cache_bytes": 3564193947, "process_rss_bytes": 481083392}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6324396260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2133e2d8fb6fbe8bb2bc071e98a75ef68a33983b8f86299196b1d6fddcd4bf21", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 180 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c0019074c06e979f48a16ca5", "attempt_id": "5304d2e9139a", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:07.970954Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 46, "compress_ms": 170.56350002530962}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521686, "side_information_bytes": 15958, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 177.93058301322162, "doc_prefill_ms": 978.4983330173418, "compress_ms": 172.0557090593502, "serialize_ms": 5.5994169088080525, "load_ms": 1.487958012148738, "receiver_prefill_ms": 0.0, "query_prefill_ms": 58.72408300638199, "ttft_ms": 58.72408300638199, "decode_ms": 276.4550409046933}, "total_wall_ms": 516.4899170631543, "ttft_ms": 58.72408300638199, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 481116160, "backend_memory": {"mlx_active_bytes": 6287548424, "mlx_peak_bytes": 6332375288, "mlx_cache_bytes": 3564128411, "process_rss_bytes": 481116160}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6332375288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6889172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2133e2d8fb6fbe8bb2bc071e98a75ef68a33983b8f86299196b1d6fddcd4bf21", "output_hash": "adcb8d196080006451756ad2fe2106d5a1b6500c0f76ffaa05d7fe704243ad3b"} | |
| 181 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "647b64c583db2c5cadd31c55", "attempt_id": "5196d54eaa5a", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:08.510922Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 2010, "keep": 251, "window_tokens": 35, "compress_ms": 162.36558405216783}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 9252864, "serialized_payload_bytes": 9268749, "side_information_bytes": 15885, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 169.9978749966249, "doc_prefill_ms": 978.4983330173418, "compress_ms": 164.06458406709135, "serialize_ms": 5.610708030872047, "load_ms": 0.975457951426506, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.04462504480034, "ttft_ms": 52.04462504480034, "decode_ms": 219.67383404262364}, "total_wall_ms": 445.0735829304904, "ttft_ms": 52.04462504480034, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 35}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 482000896, "backend_memory": {"mlx_active_bytes": 6268821512, "mlx_peak_bytes": 6301605788, "mlx_cache_bytes": 3582855323, "process_rss_bytes": 482000896}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6301605788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-141", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c3d5da842f16f311212d8a70f4b9b00acfc49bad8c8a6407cc8219c2e896e52d", "output_hash": "a9b587de3507f5e878743054a9bd92f5ac43e5c3f7d1892fa950800e78d954cf"} | |
| 182 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6450f6180643834c1f28063f", "attempt_id": "4aca836749b6", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:08.979331Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 2010, "keep": 251, "window_tokens": 41, "compress_ms": 158.90608401969075}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 9252864, "serialized_payload_bytes": 9268749, "side_information_bytes": 15885, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 166.8117920635268, "doc_prefill_ms": 978.4983330173418, "compress_ms": 160.8652089489624, "serialize_ms": 5.643125041387975, "load_ms": 3.785416018217802, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.947708004154265, "ttft_ms": 46.947708004154265, "decode_ms": 366.770250024274}, "total_wall_ms": 586.5151250036433, "ttft_ms": 46.947708004154265, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 484786176, "backend_memory": {"mlx_active_bytes": 6268821512, "mlx_peak_bytes": 6307667892, "mlx_cache_bytes": 3582855323, "process_rss_bytes": 484786176}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6307667892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5714285714285715}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c3d5da842f16f311212d8a70f4b9b00acfc49bad8c8a6407cc8219c2e896e52d", "output_hash": "2b9f266644d15d5e9fa69e24c25c5efa240ca43aa71c2a39e46dfa6ce23ba0b2"} | |
| 183 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4e99942e56b141649e7418ca", "attempt_id": "e677b431959e", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:09.592901Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 2010, "keep": 251, "window_tokens": 41, "compress_ms": 91.04545903392136}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 9252864, "serialized_payload_bytes": 9268748, "side_information_bytes": 15884, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 97.79495897237211, "doc_prefill_ms": 978.4983330173418, "compress_ms": 92.75412489660084, "serialize_ms": 4.724457976408303, "load_ms": 0.4404169740155339, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.32216698862612, "ttft_ms": 45.32216698862612, "decode_ms": 285.37225001491606}, "total_wall_ms": 430.65704102627933, "ttft_ms": 45.32216698862612, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 484835328, "backend_memory": {"mlx_active_bytes": 6268821512, "mlx_peak_bytes": 6307667892, "mlx_cache_bytes": 3582855323, "process_rss_bytes": 484835328}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6307667892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a6be719c0cf9eeedd4af5921cc6f6ec7b9168b4dc130f226b184594994e2cbcc", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 184 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5594d171faf427afef1e9cfd", "attempt_id": "0a3bbeda7871", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:10.047096Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 2010, "keep": 251, "window_tokens": 38, "compress_ms": 122.17254098504782}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 9252864, "serialized_payload_bytes": 9268749, "side_information_bytes": 15885, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 128.34070902317762, "doc_prefill_ms": 978.4983330173418, "compress_ms": 123.67729190737009, "serialize_ms": 4.361208062618971, "load_ms": 1.535917050205171, "receiver_prefill_ms": 0.0, "query_prefill_ms": 60.15229190234095, "ttft_ms": 60.15229190234095, "decode_ms": 148.79533310886472}, "total_wall_ms": 340.8499580109492, "ttft_ms": 60.15229190234095, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 38}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 484868096, "backend_memory": {"mlx_active_bytes": 6268821512, "mlx_peak_bytes": 6306619316, "mlx_cache_bytes": 3582855323, "process_rss_bytes": 484868096}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6306619316, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c3d5da842f16f311212d8a70f4b9b00acfc49bad8c8a6407cc8219c2e896e52d", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 185 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7ea0033c46473df9d3ee7fc1", "attempt_id": "9836c20c488c", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:10.410761Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 2010, "keep": 251, "window_tokens": 46, "compress_ms": 184.51749999076128}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 9252864, "serialized_payload_bytes": 9268749, "side_information_bytes": 15885, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 190.18683396279812, "doc_prefill_ms": 978.4983330173418, "compress_ms": 186.27745797857642, "serialize_ms": 3.599500050768256, "load_ms": 0.9678340284153819, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.286790940910578, "ttft_ms": 28.286790940910578, "decode_ms": 278.8742919219658}, "total_wall_ms": 500.47645904123783, "ttft_ms": 28.286790940910578, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 484900864, "backend_memory": {"mlx_active_bytes": 6268821512, "mlx_peak_bytes": 6311649224, "mlx_cache_bytes": 3582855323, "process_rss_bytes": 484900864}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6311649224, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6883757", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c3d5da842f16f311212d8a70f4b9b00acfc49bad8c8a6407cc8219c2e896e52d", "output_hash": "4f4163e571535bafb510d80d8bb642f2da7112be39e6271e34e285925abe4969"} | |
| 186 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "fc2562a4f3375f98ee156d96", "attempt_id": "7f7229f935ed", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:11.089293Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 19, "compress_ms": 136.959416908212}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521684, "side_information_bytes": 15956, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 153.9095420157537, "doc_prefill_ms": 978.4983330173418, "compress_ms": 143.25095899403095, "serialize_ms": 10.435374919325113, "load_ms": 1.522707985714078, "receiver_prefill_ms": 0.0, "query_prefill_ms": 34.654041985049844, "ttft_ms": 34.654041985049844, "decode_ms": 41.85833293013275}, "total_wall_ms": 79.97604098636657, "ttft_ms": 34.654041985049844, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 486572032, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6321594572, "mlx_cache_bytes": 3586312347, "process_rss_bytes": 486572032}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6321594572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "24f23031bd1182e38854cebc49b2df6c094404387109ed4a2e330fca479f883a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 187 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "17802194fa0119509b7e3b59", "attempt_id": "ec101ed582ce", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:11.195927Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 19, "compress_ms": 136.959416908212}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521684, "side_information_bytes": 15956, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 153.9095420157537, "doc_prefill_ms": 978.4983330173418, "compress_ms": 143.25095899403095, "serialize_ms": 10.435374919325113, "load_ms": 1.6749589703977108, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.49516696110368, "ttft_ms": 51.49516696110368, "decode_ms": 36.127666011452675}, "total_wall_ms": 91.19587496388704, "ttft_ms": 51.49516696110368, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 486572032, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6327214308, "mlx_cache_bytes": 3586312347, "process_rss_bytes": 486572032}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6327214308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "24f23031bd1182e38854cebc49b2df6c094404387109ed4a2e330fca479f883a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 188 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "47a7273716e82cdc5f65d69c", "attempt_id": "c2a787edb06f", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:11.312939Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 19, "compress_ms": 136.959416908212}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521684, "side_information_bytes": 15956, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 153.9095420157537, "doc_prefill_ms": 978.4983330173418, "compress_ms": 143.25095899403095, "serialize_ms": 10.435374919325113, "load_ms": 3.8703340105712414, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.67375001311302, "ttft_ms": 43.67375001311302, "decode_ms": 24.828667053952813}, "total_wall_ms": 73.93125002272427, "ttft_ms": 43.67375001311302, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 486572032, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6327214308, "mlx_cache_bytes": 3586312347, "process_rss_bytes": 486572032}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6327214308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "24f23031bd1182e38854cebc49b2df6c094404387109ed4a2e330fca479f883a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 189 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ebfe35e2d6e8d7620ee332c7", "attempt_id": "dd13e6cfc62c", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:11.409493Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 19, "compress_ms": 136.959416908212}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521684, "side_information_bytes": 15956, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 153.9095420157537, "doc_prefill_ms": 978.4983330173418, "compress_ms": 143.25095899403095, "serialize_ms": 10.435374919325113, "load_ms": 1.6111669829115272, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.31049994006753, "ttft_ms": 47.31049994006753, "decode_ms": 22.76508300565183}, "total_wall_ms": 73.38266691658646, "ttft_ms": 47.31049994006753, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 486572032, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6324396260, "mlx_cache_bytes": 3586312347, "process_rss_bytes": 486572032}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6324396260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "24f23031bd1182e38854cebc49b2df6c094404387109ed4a2e330fca479f883a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 190 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2e5514e6150a03d8b51a73bf", "attempt_id": "ad400896a517", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:11.506436Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 19, "compress_ms": 136.959416908212}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521684, "side_information_bytes": 15956, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 153.9095420157537, "doc_prefill_ms": 978.4983330173418, "compress_ms": 143.25095899403095, "serialize_ms": 10.435374919325113, "load_ms": 6.6071669571101665, "receiver_prefill_ms": 0.0, "query_prefill_ms": 53.84733295068145, "ttft_ms": 53.84733295068145, "decode_ms": 326.44458406139165}, "total_wall_ms": 388.4931670036167, "ttft_ms": 53.84733295068145, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 486588416, "backend_memory": {"mlx_active_bytes": 6287548424, "mlx_peak_bytes": 6332375288, "mlx_cache_bytes": 3585067163, "process_rss_bytes": 486588416}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6332375288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6620744", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "24f23031bd1182e38854cebc49b2df6c094404387109ed4a2e330fca479f883a", "output_hash": "e76b03e6d080dbb985ddc2cf22096423dd61750c5e72e827372501dee02ceb4e"} | |
| 191 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3e142b5be6d7cf9c6be18dbc", "attempt_id": "522dbe145223", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:11.917359Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 35, "compress_ms": 115.52699992898852}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521634, "side_information_bytes": 15906, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 124.4567499961704, "doc_prefill_ms": 978.4983330173418, "compress_ms": 117.3142910702154, "serialize_ms": 6.888333009555936, "load_ms": 1.62529107183218, "receiver_prefill_ms": 0.0, "query_prefill_ms": 800.1455829944462, "ttft_ms": 800.1455829944462, "decode_ms": 350.3892079461366}, "total_wall_ms": 1278.5456669516861, "ttft_ms": 800.1455829944462, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 35}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 542736384, "backend_memory": {"mlx_active_bytes": 6287466504, "mlx_peak_bytes": 6315139880, "mlx_cache_bytes": 3672254107, "process_rss_bytes": 542736384}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6315139880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-141414", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7f5fe19c286e3295a2b76fb4e8edfc381f8a46a74af827a4976a1f8203ec5727", "output_hash": "3accb8103c2ea6bde33116666e47bc4d4516c476bf679884da62e6e0a833dc04"} | |
| 192 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2fb8d2d7868b9757b6906b45", "attempt_id": "5bdc202dcc63", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:13.219009Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 41, "compress_ms": 122.03500000759959}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521634, "side_information_bytes": 15906, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.6194579489529, "doc_prefill_ms": 978.4983330173418, "compress_ms": 123.72708308976144, "serialize_ms": 9.604208054952323, "load_ms": 1.4203749597072601, "receiver_prefill_ms": 0.0, "query_prefill_ms": 1016.9714589137584, "ttft_ms": 1016.9714589137584, "decode_ms": 377.6179590495303}, "total_wall_ms": 1531.744375010021, "ttft_ms": 1016.9714589137584, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 566542336, "backend_memory": {"mlx_active_bytes": 6287745032, "mlx_peak_bytes": 6316676996, "mlx_cache_bytes": 3672223043, "process_rss_bytes": 566542336}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6316676996, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7f5fe19c286e3295a2b76fb4e8edfc381f8a46a74af827a4976a1f8203ec5727", "output_hash": "b6582a041b3d2b38ac6924099568ca2e6f1a610c6fb5f4de2e0516b90433bc2a"} | |
| 193 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "152b1c4a3d2614c7bea042f1", "attempt_id": "208d0d77bb52", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:14.775180Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 41, "compress_ms": 100.8127499371767}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521633, "side_information_bytes": 15905, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 112.16529202647507, "doc_prefill_ms": 978.4983330173418, "compress_ms": 102.71037498023361, "serialize_ms": 9.15120798163116, "load_ms": 0.5802500527352095, "receiver_prefill_ms": 0.0, "query_prefill_ms": 948.3068339759484, "ttft_ms": 948.3068339759484, "decode_ms": 304.3392919935286}, "total_wall_ms": 1367.4807919887826, "ttft_ms": 948.3068339759484, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 581877760, "backend_memory": {"mlx_active_bytes": 6287679496, "mlx_peak_bytes": 6317130848, "mlx_cache_bytes": 3672288579, "process_rss_bytes": 581877760}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6317130848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1c6b2147d42e029e8dca07f4b28e03a278fb7e32227e176a30a7d1d298e4cef0", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 194 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "848c8584aba45ac3f3289a06", "attempt_id": "1c39334b216b", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:16.168373Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 38, "compress_ms": 81.36487496085465}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521633, "side_information_bytes": 15905, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 91.60854096990079, "doc_prefill_ms": 978.4983330173418, "compress_ms": 83.10245897155255, "serialize_ms": 8.180457982234657, "load_ms": 1.1518340324983, "receiver_prefill_ms": 0.0, "query_prefill_ms": 967.3365419730544, "ttft_ms": 967.3365419730544, "decode_ms": 192.0231250114739}, "total_wall_ms": 1254.1444998933002, "ttft_ms": 967.3365419730544, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 38}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 596230144, "backend_memory": {"mlx_active_bytes": 6287417352, "mlx_peak_bytes": 6316319792, "mlx_cache_bytes": 3674647875, "process_rss_bytes": 596230144}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6316319792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1c6b2147d42e029e8dca07f4b28e03a278fb7e32227e176a30a7d1d298e4cef0", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 195 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "dc4d7ab44ba555ab3deea38f", "attempt_id": "635d72cfddd5", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:17.446601Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 46, "compress_ms": 156.07712499331683}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521634, "side_information_bytes": 15906, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 164.31133402511477, "doc_prefill_ms": 978.4983330173418, "compress_ms": 157.64266694895923, "serialize_ms": 6.35245896410197, "load_ms": 1.0650829644873738, "receiver_prefill_ms": 0.0, "query_prefill_ms": 1094.7622910607606, "ttft_ms": 1094.7622910607606, "decode_ms": 355.96962505951524}, "total_wall_ms": 1617.846457986161, "ttft_ms": 1094.7622910607606, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 46}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 613564416, "backend_memory": {"mlx_active_bytes": 6287908872, "mlx_peak_bytes": 6317799400, "mlx_cache_bytes": 3674395343, "process_rss_bytes": 613564416}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6317799400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,882,172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7f5fe19c286e3295a2b76fb4e8edfc381f8a46a74af827a4976a1f8203ec5727", "output_hash": "1886eda11e703e25a27facb91bdc6cb3774b1920e65fa8d88ed4639d56209253"} | |
| 196 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8f2b5bc28013e60d4a4330cc", "attempt_id": "65e6da0d8219", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:19.090662Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 35, "compress_ms": 201.04399998672307, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 9831168, "serialized_payload_bytes": 9864690, "side_information_bytes": 33522, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 221.37945797294378, "doc_prefill_ms": 978.4983330173418, "compress_ms": 209.87866609357297, "serialize_ms": 10.782083962112665, "load_ms": 3.587624989449978, "receiver_prefill_ms": 0.0, "query_prefill_ms": 60.996292042545974, "ttft_ms": 60.996292042545974, "decode_ms": 313.94500005990267}, "total_wall_ms": 602.8465839335695, "ttft_ms": 60.996292042545974, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 35}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 610566144, "backend_memory": {"mlx_active_bytes": 6268717192, "mlx_peak_bytes": 6309297656, "mlx_cache_bytes": 3703190263, "process_rss_bytes": 610566144}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6309297656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-1482", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7e9223c5763d06ad8b79c2db726ebbf118587b3dce8be8a16214375cf60174fc", "output_hash": "f5e9a6d78321ae31e0a3bdeeaf8c39b796c1fc12a0a8896955e8c411f428367c"} | |
| 197 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "793887e91f2b0fafb391da85", "attempt_id": "0e08344cf658", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:19.724698Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 41, "compress_ms": 96.76933393348008, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 9831168, "serialized_payload_bytes": 9864689, "side_information_bytes": 33521, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 159.62045802734792, "doc_prefill_ms": 978.4983330173418, "compress_ms": 153.05966697633266, "serialize_ms": 6.034082965925336, "load_ms": 3.6637920420616865, "receiver_prefill_ms": 0.0, "query_prefill_ms": 54.22699998598546, "ttft_ms": 54.22699998598546, "decode_ms": 410.92024999670684}, "total_wall_ms": 630.353125045076, "ttft_ms": 54.22699998598546, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 611729408, "backend_memory": {"mlx_active_bytes": 6268720512, "mlx_peak_bytes": 6314674528, "mlx_cache_bytes": 3714773159, "process_rss_bytes": 611729408}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6314674528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "eac92062bcbe3818105a60e3bbe6293aa5a070ab1c5f619945287aae7244bcfc", "output_hash": "b6582a041b3d2b38ac6924099568ca2e6f1a610c6fb5f4de2e0516b90433bc2a"} | |
| 198 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f00636fb7bdc9c02383bd003", "attempt_id": "774438419334", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:20.385890Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 41, "compress_ms": 170.21425010170788, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 9831168, "serialized_payload_bytes": 9864690, "side_information_bytes": 33522, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 189.20416699256748, "doc_prefill_ms": 978.4983330173418, "compress_ms": 180.0569590413943, "serialize_ms": 8.405499975197017, "load_ms": 1.6090830322355032, "receiver_prefill_ms": 0.0, "query_prefill_ms": 67.88970797788352, "ttft_ms": 67.88970797788352, "decode_ms": 309.36858302447945}, "total_wall_ms": 570.77833393123, "ttft_ms": 67.88970797788352, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 611762176, "backend_memory": {"mlx_active_bytes": 6268646784, "mlx_peak_bytes": 6314601720, "mlx_cache_bytes": 3714846887, "process_rss_bytes": 611762176}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6314601720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7e9223c5763d06ad8b79c2db726ebbf118587b3dce8be8a16214375cf60174fc", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 199 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "cd86b829645e0f61fb112b9f", "attempt_id": "2ad10bf5f188", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:20.985445Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 38, "compress_ms": 117.36891604959965, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 9831168, "serialized_payload_bytes": 9864690, "side_information_bytes": 33522, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 167.5742919323966, "doc_prefill_ms": 978.4983330173418, "compress_ms": 160.52779206074774, "serialize_ms": 6.497083115391433, "load_ms": 3.965583979152143, "receiver_prefill_ms": 0.0, "query_prefill_ms": 53.30499995034188, "ttft_ms": 53.30499995034188, "decode_ms": 221.48974996525794}, "total_wall_ms": 448.55570793151855, "ttft_ms": 53.30499995034188, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 38}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 611827712, "backend_memory": {"mlx_active_bytes": 6268641128, "mlx_peak_bytes": 6311321464, "mlx_cache_bytes": 3720898239, "process_rss_bytes": 611827712}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6311321464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7e9223c5763d06ad8b79c2db726ebbf118587b3dce8be8a16214375cf60174fc", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 200 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8567987fcf7d3ef563754f89", "attempt_id": "6df972514b29", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:21.463912Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 46, "compress_ms": 91.65679104626179, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 9831168, "serialized_payload_bytes": 9864689, "side_information_bytes": 33521, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 107.72583400830626, "doc_prefill_ms": 978.4983330173418, "compress_ms": 99.87862501293421, "serialize_ms": 7.305750041268766, "load_ms": 1.2198749464005232, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.16600000858307, "ttft_ms": 52.16600000858307, "decode_ms": 349.2728329729289}, "total_wall_ms": 512.5126250786707, "ttft_ms": 52.16600000858307, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 612171776, "backend_memory": {"mlx_active_bytes": 6268716160, "mlx_peak_bytes": 6319394620, "mlx_cache_bytes": 3730092375, "process_rss_bytes": 612171776}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6319394620, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6889172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "eac92062bcbe3818105a60e3bbe6293aa5a070ab1c5f619945287aae7244bcfc", "output_hash": "adcb8d196080006451756ad2fe2106d5a1b6500c0f76ffaa05d7fe704243ad3b"} | |
| 201 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a284ef353d3769af31d73449", "attempt_id": "0b615e4bea1e", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:27.093179Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597378376}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 86, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.03316707443445921, "decode_payload_ms": 0.0, "receiver_prefill_ms": 646.6909170849249, "ttft_ms": 47.980832983739674, "decode_ms": 36.75787488464266}, "total_wall_ms": 746.2564589222893, "ttft_ms": 47.980832983739674, "input_usage": {"receiver_prompt_tokens": 86}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3889004544, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12684539768, "mlx_cache_bytes": 163771776, "process_rss_bytes": 3889004544}, "peak_prefill_memory": null, "peak_decode_memory": 12684539768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 202 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a7d32ca67ec7846b7a03ff38", "attempt_id": "d65cab2b1970", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:27.893656Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 91, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.03316707443445921, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.04708401672542, "ttft_ms": 21.096749929711223, "decode_ms": 77.90612510871142}, "total_wall_ms": 153.12387503217906, "ttft_ms": 21.096749929711223, "input_usage": {"receiver_prompt_tokens": 91}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3888316416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12688086476, "mlx_cache_bytes": 226719464, "process_rss_bytes": 3888316416}, "peak_prefill_memory": null, "peak_decode_memory": 12688086476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | |
| 203 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c1fce208a1c64cf5e6afee35", "attempt_id": "93cc7bc4dbc0", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:28.080446Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 91, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.03316707443445921, "decode_payload_ms": 0.0, "receiver_prefill_ms": 51.64225003682077, "ttft_ms": 38.24829205404967, "decode_ms": 76.70120801776648}, "total_wall_ms": 167.41258301772177, "ttft_ms": 38.24829205404967, "input_usage": {"receiver_prompt_tokens": 91}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3888332800, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12688086476, "mlx_cache_bytes": 226719464, "process_rss_bytes": 3888332800}, "peak_prefill_memory": null, "peak_decode_memory": 12688086476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | |
| 204 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9ec1c73d4a4e9d72cde7212b", "attempt_id": "6fd4645d9a5f", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:28.277113Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 88, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.03316707443445921, "decode_payload_ms": 0.0, "receiver_prefill_ms": 66.67800003197044, "ttft_ms": 34.88487494178116, "decode_ms": 84.5717079937458}, "total_wall_ms": 187.05820792820305, "ttft_ms": 34.88487494178116, "input_usage": {"receiver_prompt_tokens": 88}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3888349184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12691871180, "mlx_cache_bytes": 253163240, "process_rss_bytes": 3888349184}, "peak_prefill_memory": null, "peak_decode_memory": 12691871180, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | |
| 205 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f32cc40904d767767c3ce27d", "attempt_id": "bc5e45b1ac68", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:28.492103Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 97, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.03316707443445921, "decode_payload_ms": 0.0, "receiver_prefill_ms": 45.02454097382724, "ttft_ms": 29.383999994024634, "decode_ms": 38.97570900153369}, "total_wall_ms": 114.28587499540299, "ttft_ms": 29.383999994024634, "input_usage": {"receiver_prompt_tokens": 97}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3888398336, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12691756516, "mlx_cache_bytes": 315684968, "process_rss_bytes": 3888398336}, "peak_prefill_memory": null, "peak_decode_memory": 12691756516, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 206 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3396758962deff05a4c73dcd", "attempt_id": "4cbfbfb37fc2", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:28.634823Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 1862, "message_tokens": 1766, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01770805101841688, "decode_payload_ms": 0.0, "receiver_prefill_ms": 499.6396249625832, "ttft_ms": 43.695083004422486, "decode_ms": 249.3790000444278}, "total_wall_ms": 796.4147080201656, "ttft_ms": 43.695083004422486, "input_usage": {"receiver_prompt_tokens": 1862}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3885826048, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13292777800, "mlx_cache_bytes": 1022268796, "process_rss_bytes": 3885826048}, "peak_prefill_memory": null, "peak_decode_memory": 13292777800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 207 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "fb59f1bf107d1bf128a66a27", "attempt_id": "b34d5c0a288f", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:29.461431Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 1867, "message_tokens": 1766, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01770805101841688, "decode_payload_ms": 0.0, "receiver_prefill_ms": 579.509292030707, "ttft_ms": 55.44162495061755, "decode_ms": 322.7411250118166}, "total_wall_ms": 961.2702080048621, "ttft_ms": 55.44162495061755, "input_usage": {"receiver_prompt_tokens": 1867}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3885842432, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13294137692, "mlx_cache_bytes": 1492529828, "process_rss_bytes": 3885842432}, "peak_prefill_memory": null, "peak_decode_memory": 13294137692, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "5280344bb130ba2ce68331d4c5deadfa47c813ecd5c007f5616e1ff44aa0daea"} | |
| 208 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3a92313afb8a49078d325ead", "attempt_id": "5234e5198298", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:30.450859Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 1867, "message_tokens": 1766, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01770805101841688, "decode_payload_ms": 0.0, "receiver_prefill_ms": 476.67066601570696, "ttft_ms": 62.968041049316525, "decode_ms": 180.50954199861735}, "total_wall_ms": 723.2565829763189, "ttft_ms": 62.968041049316525, "input_usage": {"receiver_prompt_tokens": 1867}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 3885842432, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13294137692, "mlx_cache_bytes": 1492529828, "process_rss_bytes": 3885842432}, "peak_prefill_memory": null, "peak_decode_memory": 13294137692, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 209 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "b3368f2891c0a96ee96f3a80", "attempt_id": "f1fa5ab919ef", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:31.199522Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 1864, "message_tokens": 1766, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01770805101841688, "decode_payload_ms": 0.0, "receiver_prefill_ms": 451.5241249464452, "ttft_ms": 42.268167017027736, "decode_ms": 200.49616694450378}, "total_wall_ms": 697.5888749584556, "ttft_ms": 42.268167017027736, "input_usage": {"receiver_prompt_tokens": 1864}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3885006848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13331100008, "mlx_cache_bytes": 1732932260, "process_rss_bytes": 3885006848}, "peak_prefill_memory": null, "peak_decode_memory": 13331100008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 210 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3c0afc9de90055c13bb3f607", "attempt_id": "ecb510fdc245", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:31.923455Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 1873, "message_tokens": 1766, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01770805101841688, "decode_payload_ms": 0.0, "receiver_prefill_ms": 429.7551669878885, "ttft_ms": 59.38220804091543, "decode_ms": 219.0751669695601}, "total_wall_ms": 712.5919159734622, "ttft_ms": 59.38220804091543, "input_usage": {"receiver_prompt_tokens": 1873}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3882303488, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13295448436, "mlx_cache_bytes": 2169999332, "process_rss_bytes": 3882303488}, "peak_prefill_memory": null, "peak_decode_memory": 13295448436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 211 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f84c1e5c2124916cc6dbb84e", "attempt_id": "fb0b068f3044", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:32.663412Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 1766}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 232, "message_tokens": 131, "message_utf8_bytes": 703, "cache_tensor_bytes": null, "serialized_payload_bytes": 703, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.4802919942885637, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.58099997695535, "ttft_ms": 26.880832971073687, "decode_ms": 25.019083986990154}, "total_wall_ms": 154.02700006961823, "ttft_ms": 26.880832971073687, "input_usage": {"receiver_prompt_tokens": 232}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3882270720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12759980020, "mlx_cache_bytes": 2288112512, "process_rss_bytes": 3882270720}, "peak_prefill_memory": null, "peak_decode_memory": 12759980020, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "acba6fb02b6e7258fce5128bcba1f258105bb31a37756a67b631e93f89e9cb50", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 212 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ee94c3b9667dec1f99dcc6e1", "attempt_id": "dafd70d2167b", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:32.851298Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 1766}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 237, "message_tokens": 131, "message_utf8_bytes": 703, "cache_tensor_bytes": null, "serialized_payload_bytes": 703, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.4802919942885637, "decode_payload_ms": 0.0, "receiver_prefill_ms": 85.92129102908075, "ttft_ms": 46.80308303795755, "decode_ms": 36.294416058808565}, "total_wall_ms": 170.1134160393849, "ttft_ms": 46.80308303795755, "input_usage": {"receiver_prompt_tokens": 237}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3878420480, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12767565832, "mlx_cache_bytes": 2414679856, "process_rss_bytes": 3878420480}, "peak_prefill_memory": null, "peak_decode_memory": 12767565832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "acba6fb02b6e7258fce5128bcba1f258105bb31a37756a67b631e93f89e9cb50", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 213 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "594463cf469011efdf778ecc", "attempt_id": "095a9a8290c3", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:33.044656Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 1766}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 237, "message_tokens": 131, "message_utf8_bytes": 703, "cache_tensor_bytes": null, "serialized_payload_bytes": 703, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.4802919942885637, "decode_payload_ms": 0.0, "receiver_prefill_ms": 84.47579201310873, "ttft_ms": 38.24570798315108, "decode_ms": 37.18833299353719}, "total_wall_ms": 161.05399990919977, "ttft_ms": 38.24570798315108, "input_usage": {"receiver_prompt_tokens": 237}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3878256640, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12767565832, "mlx_cache_bytes": 2414679856, "process_rss_bytes": 3878256640}, "peak_prefill_memory": null, "peak_decode_memory": 12767565832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "acba6fb02b6e7258fce5128bcba1f258105bb31a37756a67b631e93f89e9cb50", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 214 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "479d02184807ec5f02abd94a", "attempt_id": "b3ad3df4d752", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:33.230295Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 1766}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 234, "message_tokens": 131, "message_utf8_bytes": 703, "cache_tensor_bytes": null, "serialized_payload_bytes": 703, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.4802919942885637, "decode_payload_ms": 0.0, "receiver_prefill_ms": 94.60470802150667, "ttft_ms": 37.55633404944092, "decode_ms": 36.75004199612886}, "total_wall_ms": 170.09266698732972, "ttft_ms": 37.55633404944092, "input_usage": {"receiver_prompt_tokens": 234}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3878256640, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12770940936, "mlx_cache_bytes": 2440632112, "process_rss_bytes": 3878256640}, "peak_prefill_memory": null, "peak_decode_memory": 12770940936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "acba6fb02b6e7258fce5128bcba1f258105bb31a37756a67b631e93f89e9cb50", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 215 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "edb7327bfa87914681f8ec58", "attempt_id": "bfc302a6223a", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:33.427201Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 1766}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 243, "message_tokens": 131, "message_utf8_bytes": 703, "cache_tensor_bytes": null, "serialized_payload_bytes": 703, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.4802919942885637, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.13520804140717, "ttft_ms": 31.041332986205816, "decode_ms": 31.99995798058808}, "total_wall_ms": 143.47324997652322, "ttft_ms": 31.041332986205816, "input_usage": {"receiver_prompt_tokens": 243}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3861282816, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12766648352, "mlx_cache_bytes": 2576112376, "process_rss_bytes": 3861282816}, "peak_prefill_memory": null, "peak_decode_memory": 12766648352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "acba6fb02b6e7258fce5128bcba1f258105bb31a37756a67b631e93f89e9cb50", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 216 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ba0f7700e5edd41000a20d02", "attempt_id": "5ee8bde226ea", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:33.596034Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 1766}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 617, "message_tokens": 516, "message_utf8_bytes": 1940, "cache_tensor_bytes": null, "serialized_payload_bytes": 1940, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.340000075288117, "decode_payload_ms": 0.0, "receiver_prefill_ms": 173.50241693202406, "ttft_ms": 40.39966594427824, "decode_ms": 49.36187504790723}, "total_wall_ms": 265.28537506237626, "ttft_ms": 40.39966594427824, "input_usage": {"receiver_prompt_tokens": 617}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3860496384, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039345144, "mlx_cache_bytes": 2963874968, "process_rss_bytes": 3860496384}, "peak_prefill_memory": null, "peak_decode_memory": 13039345144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "83c1970dac87ef7396a52d14a2764a080806f090cf3b37207beb09b20af11f42", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 217 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "aa329def04e2af8950e813be", "attempt_id": "030e054b0b4c", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:33.892164Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 1766}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 622, "message_tokens": 516, "message_utf8_bytes": 1940, "cache_tensor_bytes": null, "serialized_payload_bytes": 1940, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.340000075288117, "decode_payload_ms": 0.0, "receiver_prefill_ms": 249.12733398377895, "ttft_ms": 56.85391603037715, "decode_ms": 325.82404208369553}, "total_wall_ms": 633.8349159341305, "ttft_ms": 56.85391603037715, "input_usage": {"receiver_prompt_tokens": 622}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3856957440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13050306060, "mlx_cache_bytes": 3277008460, "process_rss_bytes": 3856957440}, "peak_prefill_memory": null, "peak_decode_memory": 13050306060, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "83c1970dac87ef7396a52d14a2764a080806f090cf3b37207beb09b20af11f42", "output_hash": "5280344bb130ba2ce68331d4c5deadfa47c813ecd5c007f5616e1ff44aa0daea"} | |
| 218 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "10191d7636d6f2feeebd57e2", "attempt_id": "9e2e33cb3293", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:34.555307Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 1766}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 622, "message_tokens": 516, "message_utf8_bytes": 1940, "cache_tensor_bytes": null, "serialized_payload_bytes": 1940, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.340000075288117, "decode_payload_ms": 0.0, "receiver_prefill_ms": 187.84987495746464, "ttft_ms": 49.86991605255753, "decode_ms": 34.08675000537187}, "total_wall_ms": 273.3824170427397, "ttft_ms": 49.86991605255753, "input_usage": {"receiver_prompt_tokens": 622}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3857006592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13054139916, "mlx_cache_bytes": 3277008460, "process_rss_bytes": 3857006592}, "peak_prefill_memory": null, "peak_decode_memory": 13054139916, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "83c1970dac87ef7396a52d14a2764a080806f090cf3b37207beb09b20af11f42", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 219 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "cb128479d40644373de8a88a", "attempt_id": "f8c3d744a3f8", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:34.851168Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 1766}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 619, "message_tokens": 516, "message_utf8_bytes": 1940, "cache_tensor_bytes": null, "serialized_payload_bytes": 1940, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.340000075288117, "decode_payload_ms": 0.0, "receiver_prefill_ms": 193.6789999017492, "ttft_ms": 36.55762493144721, "decode_ms": 48.74641599599272}, "total_wall_ms": 280.6981250178069, "ttft_ms": 36.55762493144721, "input_usage": {"receiver_prompt_tokens": 619}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3856744448, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13071900172, "mlx_cache_bytes": 3516280396, "process_rss_bytes": 3856744448}, "peak_prefill_memory": null, "peak_decode_memory": 13071900172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "83c1970dac87ef7396a52d14a2764a080806f090cf3b37207beb09b20af11f42", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 220 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6607c938881b576685ecb266", "attempt_id": "c91bffda7e07", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:35.156824Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 1766}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 628, "message_tokens": 516, "message_utf8_bytes": 1940, "cache_tensor_bytes": null, "serialized_payload_bytes": 1940, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.340000075288117, "decode_payload_ms": 0.0, "receiver_prefill_ms": 223.83433301001787, "ttft_ms": 45.188624993897974, "decode_ms": 187.42116703651845}, "total_wall_ms": 457.8971250448376, "ttft_ms": 45.188624993897974, "input_usage": {"receiver_prompt_tokens": 628}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3780182016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13046619684, "mlx_cache_bytes": 3844454424, "process_rss_bytes": 3780182016}, "peak_prefill_memory": null, "peak_decode_memory": 13046619684, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "83c1970dac87ef7396a52d14a2764a080806f090cf3b37207beb09b20af11f42", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 221 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "caa7b43d8b3eeab81cb80c2f", "attempt_id": "0dee985285ea", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:35.646836Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 225, "message_tokens": 128, "message_utf8_bytes": 396, "cache_tensor_bytes": null, "serialized_payload_bytes": 396, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.4865410523489118, "decode_payload_ms": 0.0, "receiver_prefill_ms": 86.74400008749217, "ttft_ms": 27.555915992707014, "decode_ms": 41.38258297462016}, "total_wall_ms": 156.72666602768004, "ttft_ms": 27.555915992707014, "input_usage": {"receiver_prompt_tokens": 225}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3777789952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12756047860, "mlx_cache_bytes": 3950426136, "process_rss_bytes": 3777789952}, "peak_prefill_memory": null, "peak_decode_memory": 12756047860, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f81418bc710665c0ce4e278485f28f6b252e7ffd1fac97fe3e5d9356dfee344d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 222 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "06a48ab2e01c81df4c6e29ea", "attempt_id": "4078075de022", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:35.830422Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 230, "message_tokens": 128, "message_utf8_bytes": 396, "cache_tensor_bytes": null, "serialized_payload_bytes": 396, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.4865410523489118, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.36545891687274, "ttft_ms": 35.35516606643796, "decode_ms": 44.93241698946804}, "total_wall_ms": 155.7475000154227, "ttft_ms": 35.35516606643796, "input_usage": {"receiver_prompt_tokens": 230}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3777871872, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12770858996, "mlx_cache_bytes": 4009539608, "process_rss_bytes": 3777871872}, "peak_prefill_memory": null, "peak_decode_memory": 12770858996, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f81418bc710665c0ce4e278485f28f6b252e7ffd1fac97fe3e5d9356dfee344d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 223 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "25764a7d9afc2342a655efc1", "attempt_id": "1cf967571fa9", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:36.010841Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 230, "message_tokens": 128, "message_utf8_bytes": 396, "cache_tensor_bytes": null, "serialized_payload_bytes": 396, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.4865410523489118, "decode_payload_ms": 0.0, "receiver_prefill_ms": 105.6317089824006, "ttft_ms": 46.735708019696176, "decode_ms": 46.452583046630025}, "total_wall_ms": 199.71116702072322, "ttft_ms": 46.735708019696176, "input_usage": {"receiver_prompt_tokens": 230}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3777904640, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12773709812, "mlx_cache_bytes": 4009539608, "process_rss_bytes": 3777904640}, "peak_prefill_memory": null, "peak_decode_memory": 12773709812, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f81418bc710665c0ce4e278485f28f6b252e7ffd1fac97fe3e5d9356dfee344d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 224 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "982dafb312e24a42a7792a60", "attempt_id": "63b2ddb5707e", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:36.233991Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 227, "message_tokens": 128, "message_utf8_bytes": 396, "cache_tensor_bytes": null, "serialized_payload_bytes": 396, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.4865410523489118, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.63695895951241, "ttft_ms": 43.78033406101167, "decode_ms": 126.4765829546377}, "total_wall_ms": 272.0002500573173, "ttft_ms": 43.78033406101167, "input_usage": {"receiver_prompt_tokens": 227}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3777937408, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12760012788, "mlx_cache_bytes": 4106827800, "process_rss_bytes": 3777937408}, "peak_prefill_memory": null, "peak_decode_memory": 12760012788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f81418bc710665c0ce4e278485f28f6b252e7ffd1fac97fe3e5d9356dfee344d", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 225 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "51cc0f3cf36f50b79791095d", "attempt_id": "559d9339fb47", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:36.530163Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 236, "message_tokens": 128, "message_utf8_bytes": 396, "cache_tensor_bytes": null, "serialized_payload_bytes": 396, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.4865410523489118, "decode_payload_ms": 0.0, "receiver_prefill_ms": 94.85150000546128, "ttft_ms": 38.70000003371388, "decode_ms": 41.803917032666504}, "total_wall_ms": 176.40208394732326, "ttft_ms": 38.70000003371388, "input_usage": {"receiver_prompt_tokens": 236}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3777953792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12767565832, "mlx_cache_bytes": 4106827800, "process_rss_bytes": 3777953792}, "peak_prefill_memory": null, "peak_decode_memory": 12767565832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f81418bc710665c0ce4e278485f28f6b252e7ffd1fac97fe3e5d9356dfee344d", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 226 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "345f18ec5689466c3d8bad53", "attempt_id": "5c25b803c0ba", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:36.734103Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 509, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 606, "message_tokens": 509, "message_utf8_bytes": 1536, "cache_tensor_bytes": null, "serialized_payload_bytes": 1536, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.1802500123158097, "decode_payload_ms": 0.0, "receiver_prefill_ms": 176.01558403111994, "ttft_ms": 40.34449998289347, "decode_ms": 162.25595795549452}, "total_wall_ms": 384.94466699194163, "ttft_ms": 40.34449998289347, "input_usage": {"receiver_prompt_tokens": 606}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 3778215936, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13033561592, "mlx_cache_bytes": 4445272088, "process_rss_bytes": 3778215936}, "peak_prefill_memory": null, "peak_decode_memory": 13033561592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0ca1d3fed207a8962d88341b7fb1b07da00df9d8e507d786a2e99c06b18d0a62", "output_hash": "55a01495263476a6da84eabe2c22899f74b3909040b9d9d4fe8a8b6431ff9e18"} | |
| 227 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "652a3ae76e38721a35e2b8f6", "attempt_id": "c767a49c5937", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:37.143386Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 509, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 611, "message_tokens": 509, "message_utf8_bytes": 1536, "cache_tensor_bytes": null, "serialized_payload_bytes": 1536, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.1802500123158097, "decode_payload_ms": 0.0, "receiver_prefill_ms": 183.93062497489154, "ttft_ms": 38.269583019427955, "decode_ms": 48.33074996713549}, "total_wall_ms": 272.01195899397135, "ttft_ms": 38.269583019427955, "input_usage": {"receiver_prompt_tokens": 611}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3778232320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13036264952, "mlx_cache_bytes": 4741478424, "process_rss_bytes": 3778232320}, "peak_prefill_memory": null, "peak_decode_memory": 13036264952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0ca1d3fed207a8962d88341b7fb1b07da00df9d8e507d786a2e99c06b18d0a62", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 228 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "cfad773caf5f462cf4ce6dad", "attempt_id": "efc4d182688c", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:37.441327Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 509, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 611, "message_tokens": 509, "message_utf8_bytes": 1536, "cache_tensor_bytes": null, "serialized_payload_bytes": 1536, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.1802500123158097, "decode_payload_ms": 0.0, "receiver_prefill_ms": 185.83787500392646, "ttft_ms": 51.831708988174796, "decode_ms": 25.50999994855374}, "total_wall_ms": 264.68404196202755, "ttft_ms": 51.831708988174796, "input_usage": {"receiver_prompt_tokens": 611}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3778265088, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13036264952, "mlx_cache_bytes": 4741478424, "process_rss_bytes": 3778265088}, "peak_prefill_memory": null, "peak_decode_memory": 13036264952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0ca1d3fed207a8962d88341b7fb1b07da00df9d8e507d786a2e99c06b18d0a62", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 229 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0ee10688dcd2714df2d4ef36", "attempt_id": "4b8ddd641f6a", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:37.730986Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 509, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 608, "message_tokens": 509, "message_utf8_bytes": 1536, "cache_tensor_bytes": null, "serialized_payload_bytes": 1536, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.1802500123158097, "decode_payload_ms": 0.0, "receiver_prefill_ms": 200.8648751070723, "ttft_ms": 30.372041976079345, "decode_ms": 157.36887499224395}, "total_wall_ms": 390.51133301109076, "ttft_ms": 30.372041976079345, "input_usage": {"receiver_prompt_tokens": 608}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3778281472, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13065575928, "mlx_cache_bytes": 4898175000, "process_rss_bytes": 3778281472}, "peak_prefill_memory": null, "peak_decode_memory": 13065575928, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0ca1d3fed207a8962d88341b7fb1b07da00df9d8e507d786a2e99c06b18d0a62", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 230 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "73d8fd31983f5859f556bee6", "attempt_id": "99c1622af39b", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:38.147011Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 509, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 617, "message_tokens": 509, "message_utf8_bytes": 1536, "cache_tensor_bytes": null, "serialized_payload_bytes": 1536, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.1802500123158097, "decode_payload_ms": 0.0, "receiver_prefill_ms": 184.36279194429517, "ttft_ms": 42.966334032826126, "decode_ms": 208.3066669292748}, "total_wall_ms": 437.20804201439023, "ttft_ms": 42.966334032826126, "input_usage": {"receiver_prompt_tokens": 617}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3778297856, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039345144, "mlx_cache_bytes": 4898175000, "process_rss_bytes": 3778297856}, "peak_prefill_memory": null, "peak_decode_memory": 13039345144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0ca1d3fed207a8962d88341b7fb1b07da00df9d8e507d786a2e99c06b18d0a62", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 231 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "127e697cab82122cfd1999cf", "attempt_id": "c97f4425da9d", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:38.614839Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 28}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 608, "message_tokens": 511, "message_utf8_bytes": 1555, "cache_tensor_bytes": null, "serialized_payload_bytes": 1555, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.9690000442788005, "decode_payload_ms": 0.0, "receiver_prefill_ms": 146.1639580084011, "ttft_ms": 44.18754205107689, "decode_ms": 322.3565830849111}, "total_wall_ms": 515.3643330559134, "ttft_ms": 44.18754205107689, "input_usage": {"receiver_prompt_tokens": 608}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3778625536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13073079800, "mlx_cache_bytes": 4898175000, "process_rss_bytes": 3778625536}, "peak_prefill_memory": null, "peak_decode_memory": 13073079800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0ff405ac03e5a10e14d572266d362d361b4219fa184f9be3bb806057879fd9ac", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 232 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e7f66bd94321b2eec32831a9", "attempt_id": "5703b6664b58", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:39.154684Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 29}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 610, "message_tokens": 508, "message_utf8_bytes": 1715, "cache_tensor_bytes": null, "serialized_payload_bytes": 1715, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.1981669813394547, "decode_payload_ms": 0.0, "receiver_prefill_ms": 165.07095901761204, "ttft_ms": 41.04537493549287, "decode_ms": 297.8782909922302}, "total_wall_ms": 506.7767919972539, "ttft_ms": 41.04537493549287, "input_usage": {"receiver_prompt_tokens": 610}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3778592768, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13036264952, "mlx_cache_bytes": 4898175000, "process_rss_bytes": 3778592768}, "peak_prefill_memory": null, "peak_decode_memory": 13036264952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2a8e20793db30181404c83877c2fa0ce0e9f4ce155842796b2e9a4db57e4d166", "output_hash": "5280344bb130ba2ce68331d4c5deadfa47c813ecd5c007f5616e1ff44aa0daea"} | |
| 233 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "997f1353002369abfe7f7d4c", "attempt_id": "a2488decd017", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:39.686960Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 29}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 614, "message_tokens": 512, "message_utf8_bytes": 1561, "cache_tensor_bytes": null, "serialized_payload_bytes": 1561, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.2128340313211083, "decode_payload_ms": 0.0, "receiver_prefill_ms": 186.9793749647215, "ttft_ms": 42.87391703110188, "decode_ms": 155.52100003696978}, "total_wall_ms": 388.1841250695288, "ttft_ms": 42.87391703110188, "input_usage": {"receiver_prompt_tokens": 614}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 3778707456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13068918264, "mlx_cache_bytes": 5056378904, "process_rss_bytes": 3778707456}, "peak_prefill_memory": null, "peak_decode_memory": 13068918264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a53881c8306c0d00c837f52a61f488dcff8e4df7502a72cc68c383b3156842b8", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 234 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6ef8d11d45aadd5fa261753b", "attempt_id": "469f86e51af5", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:40.105304Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 22}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 606, "message_tokens": 507, "message_utf8_bytes": 1893, "cache_tensor_bytes": null, "serialized_payload_bytes": 1893, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.043542055413127, "decode_payload_ms": 0.0, "receiver_prefill_ms": 151.80062502622604, "ttft_ms": 44.20812497846782, "decode_ms": 223.0843750294298}, "total_wall_ms": 421.5364999836311, "ttft_ms": 44.20812497846782, "input_usage": {"receiver_prompt_tokens": 606}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3778756608, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13033561592, "mlx_cache_bytes": 5056378904, "process_rss_bytes": 3778756608}, "peak_prefill_memory": null, "peak_decode_memory": 13033561592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "22d6a96c1f0de138d69e1c361d6afdd8664290d33341c244479d5699bb0376d5", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 235 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "db8e21dc878e707ee4f94344", "attempt_id": "c45844d9c1ef", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:40.549920Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 19}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 620, "message_tokens": 512, "message_utf8_bytes": 1482, "cache_tensor_bytes": null, "serialized_payload_bytes": 1482, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.9942909236997366, "decode_payload_ms": 0.0, "receiver_prefill_ms": 182.39616591017693, "ttft_ms": 42.17254102695733, "decode_ms": 160.28391709551215}, "total_wall_ms": 387.1555000077933, "ttft_ms": 42.17254102695733, "input_usage": {"receiver_prompt_tokens": 620}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3778772992, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13053779468, "mlx_cache_bytes": 5178079256, "process_rss_bytes": 3778772992}, "peak_prefill_memory": null, "peak_decode_memory": 13053779468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c0695a138fc1f4f65051dbbd242a17ff0f5189f02881adece262d80283d3d1b0", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 236 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8d7b1495a8227eccbf31b2ce", "attempt_id": "053515853bc8", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:46.602802Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 228, "message_tokens": 128, "message_utf8_bytes": 344, "cache_tensor_bytes": null, "serialized_payload_bytes": 344, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5641.347291995771, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.08387500420213, "ttft_ms": 41.48470796644688, "decode_ms": 165.93720810487866}, "total_wall_ms": 309.24616602715105, "ttft_ms": 41.48470796644688, "input_usage": {"receiver_prompt_tokens": 228, "sender_input_tokens": 1900, "sender_output_tokens": 128, "sender_prefill_ms": 571.6930000344291, "sender_ttft_ms": 49.959042109549046, "sender_decode_ms": 5017.545499955304}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 3773546496, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12772956148, "mlx_cache_bytes": 5679273412, "process_rss_bytes": 3773546496}, "peak_prefill_memory": null, "peak_decode_memory": 12772956148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2e9b17f1eafffe7360614cc9ddf30c320799b427f7ef537b91abb8afc168ebe6", "output_hash": "55a01495263476a6da84eabe2c22899f74b3909040b9d9d4fe8a8b6431ff9e18"} | |
| 237 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "20173f556a1391560d44d210", "attempt_id": "9067cec23a6d", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:46.945983Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 233, "message_tokens": 128, "message_utf8_bytes": 344, "cache_tensor_bytes": null, "serialized_payload_bytes": 344, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5641.347291995771, "decode_payload_ms": 0.0, "receiver_prefill_ms": 117.037917021662, "ttft_ms": 35.58658401016146, "decode_ms": 21.81591698899865}, "total_wall_ms": 175.41499994695187, "ttft_ms": 35.58658401016146, "input_usage": {"receiver_prompt_tokens": 233, "sender_input_tokens": 1900, "sender_output_tokens": 128, "sender_prefill_ms": 571.6930000344291, "sender_ttft_ms": 49.959042109549046, "sender_decode_ms": 5017.545499955304}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3773562880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12760160264, "mlx_cache_bytes": 5679273412, "process_rss_bytes": 3773562880}, "peak_prefill_memory": null, "peak_decode_memory": 12760160264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2e9b17f1eafffe7360614cc9ddf30c320799b427f7ef537b91abb8afc168ebe6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 238 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a7a1040c9c8fad5c3d466497", "attempt_id": "013d0136d6d1", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:47.146957Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 233, "message_tokens": 128, "message_utf8_bytes": 344, "cache_tensor_bytes": null, "serialized_payload_bytes": 344, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5641.347291995771, "decode_payload_ms": 0.0, "receiver_prefill_ms": 87.82808296382427, "ttft_ms": 40.84858298301697, "decode_ms": 46.31200002040714}, "total_wall_ms": 175.95975007861853, "ttft_ms": 40.84858298301697, "input_usage": {"receiver_prompt_tokens": 233, "sender_input_tokens": 1900, "sender_output_tokens": 128, "sender_prefill_ms": 571.6930000344291, "sender_ttft_ms": 49.959042109549046, "sender_decode_ms": 5017.545499955304}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3773595648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12760160264, "mlx_cache_bytes": 5679273412, "process_rss_bytes": 3773595648}, "peak_prefill_memory": null, "peak_decode_memory": 12760160264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2e9b17f1eafffe7360614cc9ddf30c320799b427f7ef537b91abb8afc168ebe6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 239 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9103f469dfe0791cfa5628c9", "attempt_id": "af36ecb8a30b", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:47.346798Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 230, "message_tokens": 128, "message_utf8_bytes": 344, "cache_tensor_bytes": null, "serialized_payload_bytes": 344, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5641.347291995771, "decode_payload_ms": 0.0, "receiver_prefill_ms": 96.61016694735736, "ttft_ms": 21.791375009343028, "decode_ms": 38.34487497806549}, "total_wall_ms": 157.78904093895108, "ttft_ms": 21.791375009343028, "input_usage": {"receiver_prompt_tokens": 230, "sender_input_tokens": 1900, "sender_output_tokens": 128, "sender_prefill_ms": 571.6930000344291, "sender_ttft_ms": 49.959042109549046, "sender_decode_ms": 5017.545499955304}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3773644800, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12773709812, "mlx_cache_bytes": 5679273412, "process_rss_bytes": 3773644800}, "peak_prefill_memory": null, "peak_decode_memory": 12773709812, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2e9b17f1eafffe7360614cc9ddf30c320799b427f7ef537b91abb8afc168ebe6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 240 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a51c2dd7865a131d571756dd", "attempt_id": "905a906043f9", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:00:47.527386Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 239, "message_tokens": 128, "message_utf8_bytes": 344, "cache_tensor_bytes": null, "serialized_payload_bytes": 344, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5641.347291995771, "decode_payload_ms": 0.0, "receiver_prefill_ms": 108.96616708487272, "ttft_ms": 60.18854200374335, "decode_ms": 168.29575004521757}, "total_wall_ms": 338.52091699372977, "ttft_ms": 60.18854200374335, "input_usage": {"receiver_prompt_tokens": 239, "sender_input_tokens": 1900, "sender_output_tokens": 128, "sender_prefill_ms": 571.6930000344291, "sender_ttft_ms": 49.959042109549046, "sender_decode_ms": 5017.545499955304}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3773710336, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12778133536, "mlx_cache_bytes": 5714367940, "process_rss_bytes": 3773710336}, "peak_prefill_memory": null, "peak_decode_memory": 12778133536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2e9b17f1eafffe7360614cc9ddf30c320799b427f7ef537b91abb8afc168ebe6", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 241 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "428ced74553ee05e19f78f5f", "attempt_id": "289cbb2a1598", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:01:08.320092Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1542, "cache_tensor_bytes": null, "serialized_payload_bytes": 1542, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20424.734084052034, "decode_payload_ms": 0.0, "receiver_prefill_ms": 214.92629102431238, "ttft_ms": 48.71883301530033, "decode_ms": 31.92537499126047}, "total_wall_ms": 297.14354092720896, "ttft_ms": 48.71883301530033, "input_usage": {"receiver_prompt_tokens": 613, "sender_input_tokens": 1900, "sender_output_tokens": 512, "sender_prefill_ms": 491.5755409747362, "sender_ttft_ms": 46.186332940123975, "sender_decode_ms": 19884.817792102695}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3773087744, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13076094456, "mlx_cache_bytes": 6332372420, "process_rss_bytes": 3773087744}, "peak_prefill_memory": null, "peak_decode_memory": 13076094456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ecf0d8d5109958a3a6091df20f8f76e2e6236d0c7cad9bde38d66b2ba0cfd158", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 242 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0e663e96d442d11ac6429ce0", "attempt_id": "e12529af5e91", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:01:08.642964Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 618, "message_tokens": 512, "message_utf8_bytes": 1542, "cache_tensor_bytes": null, "serialized_payload_bytes": 1542, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20424.734084052034, "decode_payload_ms": 0.0, "receiver_prefill_ms": 203.25029199011624, "ttft_ms": 40.22479197010398, "decode_ms": 324.21037496533245}, "total_wall_ms": 569.3384170299396, "ttft_ms": 40.22479197010398, "input_usage": {"receiver_prompt_tokens": 618, "sender_input_tokens": 1900, "sender_output_tokens": 512, "sender_prefill_ms": 491.5755409747362, "sender_ttft_ms": 46.186332940123975, "sender_decode_ms": 19884.817792102695}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3773120512, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13075717644, "mlx_cache_bytes": 6332372420, "process_rss_bytes": 3773120512}, "peak_prefill_memory": null, "peak_decode_memory": 13075717644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 208-A in Senneterre", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ecf0d8d5109958a3a6091df20f8f76e2e6236d0c7cad9bde38d66b2ba0cfd158", "output_hash": "8adda6ea7f7c4b4c5e25c73912f64f69b8087e33cd5ba1b20ae8ef42eb564450"} | |
| 243 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "25b3cbda301f08386f38c245", "attempt_id": "0a386537cc4b", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:01:09.238377Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 618, "message_tokens": 512, "message_utf8_bytes": 1542, "cache_tensor_bytes": null, "serialized_payload_bytes": 1542, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20424.734084052034, "decode_payload_ms": 0.0, "receiver_prefill_ms": 182.19600000884384, "ttft_ms": 35.917041008360684, "decode_ms": 178.30633302219212}, "total_wall_ms": 397.90929097216576, "ttft_ms": 35.917041008360684, "input_usage": {"receiver_prompt_tokens": 618, "sender_input_tokens": 1900, "sender_output_tokens": 512, "sender_prefill_ms": 491.5755409747362, "sender_ttft_ms": 46.186332940123975, "sender_decode_ms": 19884.817792102695}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 3773104128, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13075717644, "mlx_cache_bytes": 6332372420, "process_rss_bytes": 3773104128}, "peak_prefill_memory": null, "peak_decode_memory": 13075717644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "54.0816", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ecf0d8d5109958a3a6091df20f8f76e2e6236d0c7cad9bde38d66b2ba0cfd158", "output_hash": "9ff09699eae63b135d2941f66a0725f6e31ea7e2b55bcd18c1c7c15a87fcce93"} | |
| 244 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1102d627ee27a9cde64cb837", "attempt_id": "193c15ce5878", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:01:09.659131Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 615, "message_tokens": 512, "message_utf8_bytes": 1542, "cache_tensor_bytes": null, "serialized_payload_bytes": 1542, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20424.734084052034, "decode_payload_ms": 0.0, "receiver_prefill_ms": 165.4518749564886, "ttft_ms": 26.19508292991668, "decode_ms": 183.8513750117272}, "total_wall_ms": 377.16345803346485, "ttft_ms": 26.19508292991668, "input_usage": {"receiver_prompt_tokens": 615, "sender_input_tokens": 1900, "sender_output_tokens": 512, "sender_prefill_ms": 491.5755409747362, "sender_ttft_ms": 46.186332940123975, "sender_decode_ms": 19884.817792102695}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3772956672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13038984696, "mlx_cache_bytes": 6453089732, "process_rss_bytes": 3772956672}, "peak_prefill_memory": null, "peak_decode_memory": 13038984696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ecf0d8d5109958a3a6091df20f8f76e2e6236d0c7cad9bde38d66b2ba0cfd158", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 245 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "97f9ba97d73aa0637beae37e", "attempt_id": "51fd52ea6708", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:01:10.060782Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 624, "message_tokens": 512, "message_utf8_bytes": 1542, "cache_tensor_bytes": null, "serialized_payload_bytes": 1542, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20424.734084052034, "decode_payload_ms": 0.0, "receiver_prefill_ms": 286.73566703218967, "ttft_ms": 42.25175001192838, "decode_ms": 214.2483750358224}, "total_wall_ms": 544.9058330850676, "ttft_ms": 42.25175001192838, "input_usage": {"receiver_prompt_tokens": 624, "sender_input_tokens": 1900, "sender_output_tokens": 512, "sender_prefill_ms": 491.5755409747362, "sender_ttft_ms": 46.186332940123975, "sender_decode_ms": 19884.817792102695}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3772186624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043801636, "mlx_cache_bytes": 6767269316, "process_rss_bytes": 3772186624}, "peak_prefill_memory": null, "peak_decode_memory": 13043801636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ecf0d8d5109958a3a6091df20f8f76e2e6236d0c7cad9bde38d66b2ba0cfd158", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 246 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "22f80f82df58348a0e10c3e6", "attempt_id": "d66d0f8c52b6", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:01:10.636480Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1513, "cache_tensor_bytes": null, "serialized_payload_bytes": 1513, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20642.006125068292, "decode_payload_ms": 0.0, "receiver_prefill_ms": 210.30787494964898, "ttft_ms": 26.419917005114257, "decode_ms": 272.1165840048343}, "total_wall_ms": 21153.805874986574, "ttft_ms": 26.419917005114257, "input_usage": {"receiver_prompt_tokens": 612, "sender_input_tokens": 1895, "sender_output_tokens": 512, "sender_prefill_ms": 528.0954170739278, "sender_ttft_ms": 46.52054200414568, "sender_decode_ms": 20062.497209059075}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3604430848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13075734008, "mlx_cache_bytes": 7329863108, "process_rss_bytes": 3604430848}, "peak_prefill_memory": null, "peak_decode_memory": 13075734008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9dd9dea09106b0487b5edd4e3fc61dc9dd37de22e7208c62a1703dc96ae635ff", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 247 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ce981a8248ca2c2ba8607fb7", "attempt_id": "d2e851ef1855", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:01:31.829007Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 618, "message_tokens": 512, "message_utf8_bytes": 1486, "cache_tensor_bytes": null, "serialized_payload_bytes": 1486, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20197.262541973032, "decode_payload_ms": 0.0, "receiver_prefill_ms": 244.00791700463742, "ttft_ms": 44.42862491123378, "decode_ms": 47.71812492981553}, "total_wall_ms": 20536.538999993354, "ttft_ms": 44.42862491123378, "input_usage": {"receiver_prompt_tokens": 618, "sender_input_tokens": 1900, "sender_output_tokens": 512, "sender_prefill_ms": 554.2099579470232, "sender_ttft_ms": 30.77245899476111, "sender_decode_ms": 19609.157916042022}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3590373376, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13075717644, "mlx_cache_bytes": 7329863108, "process_rss_bytes": 3590373376}, "peak_prefill_memory": null, "peak_decode_memory": 13075717644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "91ad43a7cddc577e740990174502e547c7cc13a83cfb2e641e88e96b3b5dd396", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 248 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a5d0a1fca4c625383e09cb20", "attempt_id": "21c9a79b74e1", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:01:52.396738Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 618, "message_tokens": 512, "message_utf8_bytes": 1474, "cache_tensor_bytes": null, "serialized_payload_bytes": 1474, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18946.599624934606, "decode_payload_ms": 0.0, "receiver_prefill_ms": 228.98058407008648, "ttft_ms": 45.93237501103431, "decode_ms": 144.28029209375381}, "total_wall_ms": 19367.42037499789, "ttft_ms": 45.93237501103431, "input_usage": {"receiver_prompt_tokens": 618, "sender_input_tokens": 1900, "sender_output_tokens": 512, "sender_prefill_ms": 563.5605830466375, "sender_ttft_ms": 25.609166943468153, "sender_decode_ms": 18354.33445801027}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 3589128192, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13075717644, "mlx_cache_bytes": 7329863108, "process_rss_bytes": 3589128192}, "peak_prefill_memory": null, "peak_decode_memory": 13075717644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "29487d8d50f9efb64f19a47d8529d1dd58afa0ea54331d727e20ecde4accc7a1", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 249 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4b77121bc83052f1e7672117", "attempt_id": "00e655c81d16", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:02:11.801544Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 615, "message_tokens": 512, "message_utf8_bytes": 1565, "cache_tensor_bytes": null, "serialized_payload_bytes": 1565, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20728.6467080703, "decode_payload_ms": 0.0, "receiver_prefill_ms": 187.64470797032118, "ttft_ms": 40.7695829635486, "decode_ms": 35.376082989387214}, "total_wall_ms": 20996.768583077937, "ttft_ms": 40.7695829635486, "input_usage": {"receiver_prompt_tokens": 615, "sender_input_tokens": 1897, "sender_output_tokens": 512, "sender_prefill_ms": 523.4766250941902, "sender_ttft_ms": 42.3798329429701, "sender_decode_ms": 20158.473457908258}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3584114688, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13038984696, "mlx_cache_bytes": 7516247492, "process_rss_bytes": 3584114688}, "peak_prefill_memory": null, "peak_decode_memory": 13038984696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2306a1c4a4df47a8f393f4be602f5a191db8cd6d5f6641e37e41a74154716155", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 250 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a411aa0cd3f1a458fe27a5fe", "attempt_id": "f60e8faafd54", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:02:32.827211Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 624, "message_tokens": 512, "message_utf8_bytes": 1581, "cache_tensor_bytes": null, "serialized_payload_bytes": 1581, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20795.02137505915, "decode_payload_ms": 0.0, "receiver_prefill_ms": 204.84749996103346, "ttft_ms": 36.469749989919364, "decode_ms": 197.89170799776912}, "total_wall_ms": 21236.324750003405, "ttft_ms": 36.469749989919364, "input_usage": {"receiver_prompt_tokens": 624, "sender_input_tokens": 1906, "sender_output_tokens": 512, "sender_prefill_ms": 789.7472499171272, "sender_ttft_ms": 44.0613329410553, "sender_decode_ms": 19958.223457913846}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3586129920, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043801636, "mlx_cache_bytes": 7996486536, "process_rss_bytes": 3586129920}, "peak_prefill_memory": null, "peak_decode_memory": 13043801636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9b284c68fea73856904ee3e25d4ad5f7e1af8d3838510feb5dd884e88ae3768e", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 251 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6995d544152c130ebdc5d2f5", "attempt_id": "fead225c9e34", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:02:59.720083Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 189, "message_tokens": 77, "message_utf8_bytes": 210, "cache_tensor_bytes": null, "serialized_payload_bytes": 210, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5625.177541049197, "decode_payload_ms": 0.0, "receiver_prefill_ms": 97.46275003999472, "ttft_ms": 51.00066598970443, "decode_ms": 50.12999998871237}, "total_wall_ms": 199.97641700319946, "ttft_ms": 51.00066598970443, "input_usage": {"receiver_prompt_tokens": 189, "sender_input_tokens": 1930, "sender_output_tokens": 128, "sender_prefill_ms": 576.803750009276, "sender_ttft_ms": 39.65608298312873, "sender_decode_ms": 5003.769375034608}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3594797056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12735158260, "mlx_cache_bytes": 8556876204, "process_rss_bytes": 3594797056}, "peak_prefill_memory": null, "peak_decode_memory": 12735158260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "35dbb3ab2dc1d60cc39e141154ca09e8704d2c90fe5bb7109b5ca78ea20e71d4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 252 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "88b52d091b388d6b7ede811e", "attempt_id": "bf48fc6f6150", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:02:59.953172Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 194, "message_tokens": 77, "message_utf8_bytes": 210, "cache_tensor_bytes": null, "serialized_payload_bytes": 210, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5625.177541049197, "decode_payload_ms": 0.0, "receiver_prefill_ms": 130.64370898064226, "ttft_ms": 61.05958390980959, "decode_ms": 35.76737502589822}, "total_wall_ms": 228.54999999981374, "ttft_ms": 61.05958390980959, "input_usage": {"receiver_prompt_tokens": 194, "sender_input_tokens": 1930, "sender_output_tokens": 128, "sender_prefill_ms": 576.803750009276, "sender_ttft_ms": 39.65608298312873, "sender_decode_ms": 5003.769375034608}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3596992512, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12738353140, "mlx_cache_bytes": 8672694700, "process_rss_bytes": 3596992512}, "peak_prefill_memory": null, "peak_decode_memory": 12738353140, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "35dbb3ab2dc1d60cc39e141154ca09e8704d2c90fe5bb7109b5ca78ea20e71d4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 253 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a4735a7e8257ac12694fff6f", "attempt_id": "bb3e83cd2664", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:03:00.205379Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 194, "message_tokens": 77, "message_utf8_bytes": 210, "cache_tensor_bytes": null, "serialized_payload_bytes": 210, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5625.177541049197, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.25345897860825, "ttft_ms": 24.811208015307784, "decode_ms": 31.53608296997845}, "total_wall_ms": 138.62183294259012, "ttft_ms": 24.811208015307784, "input_usage": {"receiver_prompt_tokens": 194, "sender_input_tokens": 1930, "sender_output_tokens": 128, "sender_prefill_ms": 576.803750009276, "sender_ttft_ms": 39.65608298312873, "sender_decode_ms": 5003.769375034608}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3597139968, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12738353140, "mlx_cache_bytes": 8672694700, "process_rss_bytes": 3597139968}, "peak_prefill_memory": null, "peak_decode_memory": 12738353140, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "35dbb3ab2dc1d60cc39e141154ca09e8704d2c90fe5bb7109b5ca78ea20e71d4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 254 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3c03e6421ed4216ad1c307b1", "attempt_id": "34f8e7cb19cb", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:03:00.366261Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 191, "message_tokens": 77, "message_utf8_bytes": 210, "cache_tensor_bytes": null, "serialized_payload_bytes": 210, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5625.177541049197, "decode_payload_ms": 0.0, "receiver_prefill_ms": 96.54499997850507, "ttft_ms": 38.16462494432926, "decode_ms": 21.445749909617007}, "total_wall_ms": 157.2988749248907, "ttft_ms": 38.16462494432926, "input_usage": {"receiver_prompt_tokens": 191, "sender_input_tokens": 1930, "sender_output_tokens": 128, "sender_prefill_ms": 576.803750009276, "sender_ttft_ms": 39.65608298312873, "sender_decode_ms": 5003.769375034608}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3597287424, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12746725364, "mlx_cache_bytes": 8721846700, "process_rss_bytes": 3597287424}, "peak_prefill_memory": null, "peak_decode_memory": 12746725364, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "35dbb3ab2dc1d60cc39e141154ca09e8704d2c90fe5bb7109b5ca78ea20e71d4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 255 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "724e8d82bd118cbd836d9e9a", "attempt_id": "486254f7ade7", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:03:00.546141Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 200, "message_tokens": 77, "message_utf8_bytes": 210, "cache_tensor_bytes": null, "serialized_payload_bytes": 210, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5625.177541049197, "decode_payload_ms": 0.0, "receiver_prefill_ms": 113.62566601019353, "ttft_ms": 51.48070794530213, "decode_ms": 38.16312493290752}, "total_wall_ms": 204.06833302695304, "ttft_ms": 51.48070794530213, "input_usage": {"receiver_prompt_tokens": 200, "sender_input_tokens": 1930, "sender_output_tokens": 128, "sender_prefill_ms": 576.803750009276, "sender_ttft_ms": 39.65608298312873, "sender_decode_ms": 5003.769375034608}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3597385728, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12741433332, "mlx_cache_bytes": 8833470892, "process_rss_bytes": 3597385728}, "peak_prefill_memory": null, "peak_decode_memory": 12741433332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "35dbb3ab2dc1d60cc39e141154ca09e8704d2c90fe5bb7109b5ca78ea20e71d4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 256 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5bef07f08cb881e3c8028b8a", "attempt_id": "1ea43cead5a3", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:03:21.158516Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 443, "message_tokens": 331, "message_utf8_bytes": 922, "cache_tensor_bytes": null, "serialized_payload_bytes": 922, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20381.38583302498, "decode_payload_ms": 0.0, "receiver_prefill_ms": 211.09137497842312, "ttft_ms": 46.4358750032261, "decode_ms": 58.35525004658848}, "total_wall_ms": 320.40841702837497, "ttft_ms": 46.4358750032261, "input_usage": {"receiver_prompt_tokens": 443, "sender_input_tokens": 1930, "sender_output_tokens": 512, "sender_prefill_ms": 542.0022499747574, "sender_ttft_ms": 51.74754199106246, "sender_decode_ms": 19785.18566605635}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3597746176, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12910582872, "mlx_cache_bytes": 9097286060, "process_rss_bytes": 3597746176}, "peak_prefill_memory": null, "peak_decode_memory": 12910582872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e137340f68268b678688cd455e9b3cd6eb172e1f73407cc86ea551d8a3db9112", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 257 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0e23375af16b6aee689f29f3", "attempt_id": "83f8b1cc98c7", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:03:21.505258Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 448, "message_tokens": 331, "message_utf8_bytes": 922, "cache_tensor_bytes": null, "serialized_payload_bytes": 922, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20381.38583302498, "decode_payload_ms": 0.0, "receiver_prefill_ms": 169.4847500184551, "ttft_ms": 44.026584015227854, "decode_ms": 23.957833996973932}, "total_wall_ms": 238.91579103656113, "ttft_ms": 44.026584015227854, "input_usage": {"receiver_prompt_tokens": 448, "sender_input_tokens": 1930, "sender_output_tokens": 512, "sender_prefill_ms": 542.0022499747574, "sender_ttft_ms": 51.74754199106246, "sender_decode_ms": 19785.18566605635}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3598647296, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12913482840, "mlx_cache_bytes": 9303527852, "process_rss_bytes": 3598647296}, "peak_prefill_memory": null, "peak_decode_memory": 12913482840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e137340f68268b678688cd455e9b3cd6eb172e1f73407cc86ea551d8a3db9112", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 258 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "980b5873ccdc4bc8d0d3bea7", "attempt_id": "9568f2328455", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:03:21.767942Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 448, "message_tokens": 331, "message_utf8_bytes": 922, "cache_tensor_bytes": null, "serialized_payload_bytes": 922, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20381.38583302498, "decode_payload_ms": 0.0, "receiver_prefill_ms": 130.19375002477318, "ttft_ms": 39.86916702706367, "decode_ms": 165.94016598537564}, "total_wall_ms": 338.1506250007078, "ttft_ms": 39.86916702706367, "input_usage": {"receiver_prompt_tokens": 448, "sender_input_tokens": 1930, "sender_output_tokens": 512, "sender_prefill_ms": 542.0022499747574, "sender_ttft_ms": 51.74754199106246, "sender_decode_ms": 19785.18566605635}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 3598598144, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12913482840, "mlx_cache_bytes": 9303527852, "process_rss_bytes": 3598598144}, "peak_prefill_memory": null, "peak_decode_memory": 12913482840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "58.0820", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e137340f68268b678688cd455e9b3cd6eb172e1f73407cc86ea551d8a3db9112", "output_hash": "b38eb8a0b5e545425ac83b4aa75ce5fda3dec19e0fb0d34757f1276e1e89f55b"} | |
| 259 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "492a0ba2df92a88fd3e6ed02", "attempt_id": "4c607b027e17", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:03:22.158860Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 445, "message_tokens": 331, "message_utf8_bytes": 922, "cache_tensor_bytes": null, "serialized_payload_bytes": 922, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20381.38583302498, "decode_payload_ms": 0.0, "receiver_prefill_ms": 140.3645829996094, "ttft_ms": 42.18208394013345, "decode_ms": 41.18258401285857}, "total_wall_ms": 224.88687501754612, "ttft_ms": 42.18208394013345, "input_usage": {"receiver_prompt_tokens": 445, "sender_input_tokens": 1930, "sender_output_tokens": 512, "sender_prefill_ms": 542.0022499747574, "sender_ttft_ms": 51.74754199106246, "sender_decode_ms": 19785.18566605635}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3598729216, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12934405208, "mlx_cache_bytes": 9461830060, "process_rss_bytes": 3598729216}, "peak_prefill_memory": null, "peak_decode_memory": 12934405208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e137340f68268b678688cd455e9b3cd6eb172e1f73407cc86ea551d8a3db9112", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 260 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "acacd6b743285814b87f0c9e", "attempt_id": "4849490861c7", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:03:22.406409Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 454, "message_tokens": 331, "message_utf8_bytes": 922, "cache_tensor_bytes": null, "serialized_payload_bytes": 922, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20381.38583302498, "decode_payload_ms": 0.0, "receiver_prefill_ms": 120.25937507860363, "ttft_ms": 41.369040962308645, "decode_ms": 37.083958042785525}, "total_wall_ms": 200.09916694834828, "ttft_ms": 41.369040962308645, "input_usage": {"receiver_prompt_tokens": 454, "sender_input_tokens": 1930, "sender_output_tokens": 512, "sender_prefill_ms": 542.0022499747574, "sender_ttft_ms": 51.74754199106246, "sender_decode_ms": 19785.18566605635}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3598942208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12916857944, "mlx_cache_bytes": 9687470508, "process_rss_bytes": 3598942208}, "peak_prefill_memory": null, "peak_decode_memory": 12916857944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e137340f68268b678688cd455e9b3cd6eb172e1f73407cc86ea551d8a3db9112", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 261 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6ba802baece955a4c430ccb3", "attempt_id": "a47d1fba5375", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:03:22.629852Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 161, "message_tokens": 50, "message_utf8_bytes": 147, "cache_tensor_bytes": null, "serialized_payload_bytes": 147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3997.8360410314053, "decode_payload_ms": 0.0, "receiver_prefill_ms": 59.751334018073976, "ttft_ms": 28.48724997602403, "decode_ms": 224.68370792921633}, "total_wall_ms": 4311.391124967486, "ttft_ms": 28.48724997602403, "input_usage": {"receiver_prompt_tokens": 161, "sender_input_tokens": 1938, "sender_output_tokens": 87, "sender_prefill_ms": 599.2695840541273, "sender_ttft_ms": 29.5200829859823, "sender_decode_ms": 3366.715291980654}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3599089664, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12718430196, "mlx_cache_bytes": 10271125488, "process_rss_bytes": 3599089664}, "peak_prefill_memory": null, "peak_decode_memory": 12718430196, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c72a627e0cf29260244c44bf815ab8cf0b8705e86bc07d7006580ba6c488eda0", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 262 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5929aded800e0179e77f82b6", "attempt_id": "065d21178792", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:03:26.963438Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 222, "message_tokens": 105, "message_utf8_bytes": 289, "cache_tensor_bytes": null, "serialized_payload_bytes": 289, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7774.181458051316, "decode_payload_ms": 0.0, "receiver_prefill_ms": 95.50508309621364, "ttft_ms": 30.069499975070357, "decode_ms": 313.801083015278}, "total_wall_ms": 8222.901499946602, "ttft_ms": 30.069499975070357, "input_usage": {"receiver_prompt_tokens": 222, "sender_input_tokens": 1943, "sender_output_tokens": 182, "sender_prefill_ms": 599.0744999144226, "sender_ttft_ms": 48.124958062544465, "sender_decode_ms": 7124.400041997433}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 3599515648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12763191284, "mlx_cache_bytes": 10753363528, "process_rss_bytes": 3599515648}, "peak_prefill_memory": null, "peak_decode_memory": 12763191284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C in Schefferville", "evidence_artifact": {"n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "addd40a49f09c20ba23134d69862c463ede74c1ceea507f21607a4ca03cf1ab8", "output_hash": "3491362e6ed6bb557ea2c25e29286d6fdbd0a0a36995d38446eddfd8450e097c"} | |
| 263 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8af7c4e55864cbd01789515e", "attempt_id": "bde0e7a121a6", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:03:35.209052Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 164, "message_tokens": 48, "message_utf8_bytes": 145, "cache_tensor_bytes": null, "serialized_payload_bytes": 145, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3852.028665947728, "decode_payload_ms": 0.0, "receiver_prefill_ms": 88.19045801647007, "ttft_ms": 37.209332920610905, "decode_ms": 136.8822909425944}, "total_wall_ms": 4115.27766706422, "ttft_ms": 37.209332920610905, "input_usage": {"receiver_prompt_tokens": 164, "sender_input_tokens": 1943, "sender_output_tokens": 84, "sender_prefill_ms": 538.9621669892222, "sender_ttft_ms": 44.171374989673495, "sender_decode_ms": 3266.4305000798777}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 3600252928, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12721264628, "mlx_cache_bytes": 10835283528, "process_rss_bytes": 3600252928}, "peak_prefill_memory": null, "peak_decode_memory": 12721264628, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "31baf496b39028b8cc95ba9496c01e4bb9f04e980ba244ba50daf05a4b91f94c", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 264 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f1788b1dff3714eadc8b12a0", "attempt_id": "2dc07798d547", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:03:39.350507Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 217, "message_tokens": 104, "message_utf8_bytes": 313, "cache_tensor_bytes": null, "serialized_payload_bytes": 313, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 6098.952625063248, "decode_payload_ms": 0.0, "receiver_prefill_ms": 83.87491700705141, "ttft_ms": 47.02287493273616, "decode_ms": 206.12279104534537}, "total_wall_ms": 6437.198500032537, "ttft_ms": 47.02287493273616, "input_usage": {"receiver_prompt_tokens": 217, "sender_input_tokens": 1940, "sender_output_tokens": 142, "sender_prefill_ms": 549.4602499529719, "sender_ttft_ms": 44.020541943609715, "sender_decode_ms": 5503.327457932755}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3600859136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12750886900, "mlx_cache_bytes": 11214261832, "process_rss_bytes": 3600859136}, "peak_prefill_memory": null, "peak_decode_memory": 12750886900, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": {"n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0811958caf7a52851bac715e86687376bf728346117ef4252fa8c9e446fe2608", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 265 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7c7b92fb4d30923f144f1ec7", "attempt_id": "6ffb5ede1b9a", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:03:45.812798Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 217, "message_tokens": 95, "message_utf8_bytes": 278, "cache_tensor_bytes": null, "serialized_payload_bytes": 278, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7845.560916000977, "decode_payload_ms": 0.0, "receiver_prefill_ms": 96.32320899982005, "ttft_ms": 36.083459039218724, "decode_ms": 172.51179204322398}, "total_wall_ms": 8151.500792009756, "ttft_ms": 36.083459039218724, "input_usage": {"receiver_prompt_tokens": 217, "sender_input_tokens": 1949, "sender_output_tokens": 182, "sender_prefill_ms": 603.8642500061542, "sender_ttft_ms": 48.5035419696942, "sender_decode_ms": 7190.499042044394}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3600728064, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12750886900, "mlx_cache_bytes": 11705232568, "process_rss_bytes": 3600728064}, "peak_prefill_memory": null, "peak_decode_memory": 12750886900, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,280,585", "evidence_artifact": {"n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "42dba6c4278b5de74823571ae9218b5b1c30d19c0268efeebae70b27470a211c", "output_hash": "2b81d1bd559c98218f68f4bc6bf62ababe33d07bcf6ec2cd6c2cd0508c0e52b5"} | |
| 266 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "99d4df471da32d3eaa2e1485", "attempt_id": "4b1100886435", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:04:14.717364Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 9}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 918, "message_tokens": 821, "message_utf8_bytes": 816, "cache_tensor_bytes": null, "serialized_payload_bytes": 816, "side_information_bytes": 0, "fetched_bytes": 1496, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20721.087167039514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 321.0716659668833, "ttft_ms": 42.953374912030995, "decode_ms": 230.6852920446545}, "total_wall_ms": 603.3002500189468, "ttft_ms": 42.953374912030995, "input_usage": {"receiver_prompt_tokens": 918, "sender_input_tokens": 1930, "sender_output_tokens": 512, "sender_prefill_ms": 530.5115839000791, "sender_ttft_ms": 54.95133297517896, "sender_decode_ms": 20116.843333933502}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3601760256, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13135064152, "mlx_cache_bytes": 12251032760, "process_rss_bytes": 3601760256}, "peak_prefill_memory": null, "peak_decode_memory": 13135064152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1496, "retrieved_refs": 6}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "20e51e9edfce0f1f7bbb42564f4a801681629d693f39bdfd2f0fa18174b9872c", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 267 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5de78be20e5e108aac62fe9c", "attempt_id": "c3fbd7f05892", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:04:15.378119Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 9}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 927, "message_tokens": 825, "message_utf8_bytes": 816, "cache_tensor_bytes": null, "serialized_payload_bytes": 816, "side_information_bytes": 0, "fetched_bytes": 1498, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20721.087167039514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 274.8143330682069, "ttft_ms": 48.13245800323784, "decode_ms": 39.0927919652313}, "total_wall_ms": 364.51254202984273, "ttft_ms": 48.13245800323784, "input_usage": {"receiver_prompt_tokens": 927, "sender_input_tokens": 1930, "sender_output_tokens": 512, "sender_prefill_ms": 530.5115839000791, "sender_ttft_ms": 54.95133297517896, "sender_decode_ms": 20116.843333933502}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3601498112, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13139323992, "mlx_cache_bytes": 12683865272, "process_rss_bytes": 3601498112}, "peak_prefill_memory": null, "peak_decode_memory": 13139323992, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1498, "retrieved_refs": 6}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "dd58c6723f7a488b688a9800bd53ab4c41b6262ba448a078f439a766616620c8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 268 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f1429aaa125142c058b71849", "attempt_id": "deacb48e5f82", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:04:15.770696Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 9}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 911, "message_tokens": 809, "message_utf8_bytes": 816, "cache_tensor_bytes": null, "serialized_payload_bytes": 816, "side_information_bytes": 0, "fetched_bytes": 1498, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20721.087167039514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 276.44220809452236, "ttft_ms": 47.264749999158084, "decode_ms": 118.47975000273436}, "total_wall_ms": 444.5243339287117, "ttft_ms": 47.264749999158084, "input_usage": {"receiver_prompt_tokens": 911, "sender_input_tokens": 1930, "sender_output_tokens": 512, "sender_prefill_ms": 530.5115839000791, "sender_ttft_ms": 54.95133297517896, "sender_decode_ms": 20116.843333933502}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 3601580032, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13136096332, "mlx_cache_bytes": 13109226680, "process_rss_bytes": 3601580032}, "peak_prefill_memory": null, "peak_decode_memory": 13136096332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1498, "retrieved_refs": 6}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e1819d55abb157660a30ec7e8741d5ff9892523ece3b510e1752a6800ca62402", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 269 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "60fa1d3ed9e802473645af25", "attempt_id": "b17d0fc3cc79", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:04:16.245634Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 9}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 924, "message_tokens": 825, "message_utf8_bytes": 816, "cache_tensor_bytes": null, "serialized_payload_bytes": 816, "side_information_bytes": 0, "fetched_bytes": 1498, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20721.087167039514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 254.21837496105582, "ttft_ms": 45.98754202015698, "decode_ms": 45.53999996278435}, "total_wall_ms": 347.8957919869572, "ttft_ms": 45.98754202015698, "input_usage": {"receiver_prompt_tokens": 924, "sender_input_tokens": 1930, "sender_output_tokens": 512, "sender_prefill_ms": 530.5115839000791, "sender_ttft_ms": 54.95133297517896, "sender_decode_ms": 20116.843333933502}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3601645568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13172960344, "mlx_cache_bytes": 13305932984, "process_rss_bytes": 3601645568}, "peak_prefill_memory": null, "peak_decode_memory": 13172960344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1498, "retrieved_refs": 6}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "dd58c6723f7a488b688a9800bd53ab4c41b6262ba448a078f439a766616620c8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 270 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a5cf7a10d76902e97c770625", "attempt_id": "d10cebc4858a", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:04:16.619269Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 9}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 933, "message_tokens": 825, "message_utf8_bytes": 816, "cache_tensor_bytes": null, "serialized_payload_bytes": 816, "side_information_bytes": 0, "fetched_bytes": 1498, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20721.087167039514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 350.99987499415874, "ttft_ms": 44.614207930862904, "decode_ms": 44.20558304991573}, "total_wall_ms": 441.8494999408722, "ttft_ms": 44.614207930862904, "input_usage": {"receiver_prompt_tokens": 933, "sender_input_tokens": 1930, "sender_output_tokens": 512, "sender_prefill_ms": 530.5115839000791, "sender_ttft_ms": 54.95133297517896, "sender_decode_ms": 20116.843333933502}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3599319040, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13142240344, "mlx_cache_bytes": 13741436088, "process_rss_bytes": 3599319040}, "peak_prefill_memory": null, "peak_decode_memory": 13142240344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1498, "retrieved_refs": 6}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "dd58c6723f7a488b688a9800bd53ab4c41b6262ba448a078f439a766616620c8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 271 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c37478f39ebe4035cc5d407f", "attempt_id": "a79639b76c38", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:04:17.091736Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 3.5135135135135136}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 1862, "message_tokens": 1766, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 2072, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 6.017500068992376, "decode_payload_ms": 1.055374974384904, "receiver_prefill_ms": 1814.1077500768006, "ttft_ms": 76.46991696674377, "decode_ms": 210.28058300726116}, "total_wall_ms": 2104.59979204461, "ttft_ms": 76.46991696674377, "input_usage": {"receiver_prompt_tokens": 1862}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3599433728, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13292777800, "mlx_cache_bytes": 13741436088, "process_rss_bytes": 3599433728}, "peak_prefill_memory": null, "peak_decode_memory": 13292777800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 272 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "31002a6132e639370f1850ec", "attempt_id": "4713436e0c42", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:04:19.220105Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 3.5135135135135136}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 1867, "message_tokens": 1766, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 2072, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 6.017500068992376, "decode_payload_ms": 1.055374974384904, "receiver_prefill_ms": 1839.8289170581847, "ttft_ms": 79.6069169882685, "decode_ms": 391.9770420761779}, "total_wall_ms": 2314.7951250430197, "ttft_ms": 79.6069169882685, "input_usage": {"receiver_prompt_tokens": 1867}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3599876096, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13294137692, "mlx_cache_bytes": 13741436088, "process_rss_bytes": 3599876096}, "peak_prefill_memory": null, "peak_decode_memory": 13294137692, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "5280344bb130ba2ce68331d4c5deadfa47c813ecd5c007f5616e1ff44aa0daea"} | |
| 273 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "cf27bcbc3d04c61c9f6e5525", "attempt_id": "2675eae23f9a", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:04:21.566364Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 3.5135135135135136}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 1867, "message_tokens": 1766, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 2072, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 6.017500068992376, "decode_payload_ms": 1.055374974384904, "receiver_prefill_ms": 445.6370419356972, "ttft_ms": 54.01791702024639, "decode_ms": 142.66737492289394}, "total_wall_ms": 649.3898750049993, "ttft_ms": 54.01791702024639, "input_usage": {"receiver_prompt_tokens": 1867}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 3600891904, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13294137692, "mlx_cache_bytes": 13741436088, "process_rss_bytes": 3600891904}, "peak_prefill_memory": null, "peak_decode_memory": 13294137692, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 274 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d7a6807ea4e7444a7c339346", "attempt_id": "3ff2da2660f8", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:04:22.241231Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 3.5135135135135136}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 1864, "message_tokens": 1766, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 2072, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 6.017500068992376, "decode_payload_ms": 1.055374974384904, "receiver_prefill_ms": 1245.138332946226, "ttft_ms": 39.491834002546966, "decode_ms": 205.1546670263633}, "total_wall_ms": 1494.151708087884, "ttft_ms": 39.491834002546966, "input_usage": {"receiver_prompt_tokens": 1864}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3600891904, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13350957404, "mlx_cache_bytes": 13741436088, "process_rss_bytes": 3600891904}, "peak_prefill_memory": null, "peak_decode_memory": 13350957404, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 275 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0498b9294db4687d717cf6b2", "attempt_id": "23d6ed0e40ac", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:04:23.770962Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 3.5135135135135136}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 1873, "message_tokens": 1766, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 2072, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 6.017500068992376, "decode_payload_ms": 1.055374974384904, "receiver_prefill_ms": 1686.4200419513509, "ttft_ms": 75.48991695512086, "decode_ms": 241.7446660110727}, "total_wall_ms": 2010.096958023496, "ttft_ms": 75.48991695512086, "input_usage": {"receiver_prompt_tokens": 1873}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3599466496, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13295448436, "mlx_cache_bytes": 13741436088, "process_rss_bytes": 3599466496}, "peak_prefill_memory": null, "peak_decode_memory": 13295448436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 276 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8c5fa58d6df871b44a252734", "attempt_id": "502dce2c3c18", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:04:35.953137Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.289920724801812, "origin_tokens": 1766, "compressed_tokens": 614, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 712, "message_tokens": 614, "message_utf8_bytes": 2137, "cache_tensor_bytes": null, "serialized_payload_bytes": 2137, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10146.664374973625, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2001.7235840205103, "ttft_ms": 76.0445409687236, "decode_ms": 259.1408339794725}, "total_wall_ms": 2345.732417074032, "ttft_ms": 76.0445409687236, "input_usage": {"receiver_prompt_tokens": 712}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 920567808, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13094805364, "mlx_cache_bytes": 13999536084, "process_rss_bytes": 920567808}, "peak_prefill_memory": null, "peak_decode_memory": 13094805364, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "4ec8cdaea66fb7e8375b214400c40c867cab583421593e5329c5a55cb2af7409", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 277 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2361486513a2aca96f995f57", "attempt_id": "ce2f5a2ceb9a", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:04:38.340677Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.289920724801812, "origin_tokens": 1766, "compressed_tokens": 614, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 717, "message_tokens": 614, "message_utf8_bytes": 2137, "cache_tensor_bytes": null, "serialized_payload_bytes": 2137, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10146.664374973625, "decode_payload_ms": 0.0, "receiver_prefill_ms": 292.01187496073544, "ttft_ms": 28.167291078716516, "decode_ms": 407.5574999442324}, "total_wall_ms": 729.3605839367956, "ttft_ms": 28.167291078716516, "input_usage": {"receiver_prompt_tokens": 717}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 898138112, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13097869192, "mlx_cache_bytes": 14400209668, "process_rss_bytes": 898138112}, "peak_prefill_memory": null, "peak_decode_memory": 13097869192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "4ec8cdaea66fb7e8375b214400c40c867cab583421593e5329c5a55cb2af7409", "output_hash": "5280344bb130ba2ce68331d4c5deadfa47c813ecd5c007f5616e1ff44aa0daea"} | |
| 278 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3b990d8e10b38d4a2484cacb", "attempt_id": "01348f321875", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:04:39.095317Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.289920724801812, "origin_tokens": 1766, "compressed_tokens": 614, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 717, "message_tokens": 614, "message_utf8_bytes": 2137, "cache_tensor_bytes": null, "serialized_payload_bytes": 2137, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10146.664374973625, "decode_payload_ms": 0.0, "receiver_prefill_ms": 177.63070797082037, "ttft_ms": 47.054416965693235, "decode_ms": 45.7099579507485}, "total_wall_ms": 272.4139579804614, "ttft_ms": 47.054416965693235, "input_usage": {"receiver_prompt_tokens": 717}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 898187264, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13097869192, "mlx_cache_bytes": 14400209668, "process_rss_bytes": 898187264}, "peak_prefill_memory": null, "peak_decode_memory": 13097869192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "58", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "4ec8cdaea66fb7e8375b214400c40c867cab583421593e5329c5a55cb2af7409", "output_hash": "6208ef0f7750c111548cf90b6ea1d0d0a66f6bff40dbef07cb45ec436263c7d6"} | |
| 279 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c06310f4531467fbcc43dc80", "attempt_id": "d02c96c4d959", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:04:39.395443Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.289920724801812, "origin_tokens": 1766, "compressed_tokens": 614, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 714, "message_tokens": 614, "message_utf8_bytes": 2137, "cache_tensor_bytes": null, "serialized_payload_bytes": 2137, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10146.664374973625, "decode_payload_ms": 0.0, "receiver_prefill_ms": 872.7607920300215, "ttft_ms": 43.66558406036347, "decode_ms": 117.28408397175372}, "total_wall_ms": 1036.4190000109375, "ttft_ms": 43.66558406036347, "input_usage": {"receiver_prompt_tokens": 714}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 898301952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13073801084, "mlx_cache_bytes": 14413382404, "process_rss_bytes": 898301952}, "peak_prefill_memory": null, "peak_decode_memory": 13073801084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "4ec8cdaea66fb7e8375b214400c40c867cab583421593e5329c5a55cb2af7409", "output_hash": "55a01495263476a6da84eabe2c22899f74b3909040b9d9d4fe8a8b6431ff9e18"} | |
| 280 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f20f0a0b88df81527aa8cf6d", "attempt_id": "8f1ce5e6206d", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T04:04:40.457348Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.289920724801812, "origin_tokens": 1766, "compressed_tokens": 614, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 723, "message_tokens": 614, "message_utf8_bytes": 2137, "cache_tensor_bytes": null, "serialized_payload_bytes": 2137, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10146.664374973625, "decode_payload_ms": 0.0, "receiver_prefill_ms": 256.8385830381885, "ttft_ms": 41.778458980843425, "decode_ms": 174.55495800822973}, "total_wall_ms": 474.94841692969203, "ttft_ms": 41.778458980843425, "input_usage": {"receiver_prompt_tokens": 723}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 898465792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13101178784, "mlx_cache_bytes": 14817234508, "process_rss_bytes": 898465792}, "peak_prefill_memory": null, "peak_decode_memory": 13101178784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6, 889", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "4ec8cdaea66fb7e8375b214400c40c867cab583421593e5329c5a55cb2af7409", "output_hash": "ea1ec5a4baf1ad028e31f3f84288177e501d178ea3163a5beb1edb15fbaa34bb"} | |
added
runs/raw/ED_hosted_pilot.jsonl
+40 −0
@@ -0,0 +1,40 @@ | ||
| 1 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "f31432ec4698c524330197a2", "attempt_id": "0548a5c7dbe8", "run_group_id": "ED_hosted_pilot:A0|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:12.578674Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": null} | |
| 2 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "2dbb71bf5d2e69bf7b578cbb", "attempt_id": "ae74bd79078a", "run_group_id": "ED_hosted_pilot:A0|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:12.620232Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": null} | |
| 3 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "0cead66cc8abd58b68a22b80", "attempt_id": "325576830536", "run_group_id": "ED_hosted_pilot:A0|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:12.650036Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": null} | |
| 4 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "033110b7c960798c91b9a567", "attempt_id": "94bb2de5591e", "run_group_id": "ED_hosted_pilot:A0|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:12.679575Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": null} | |
| 5 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "5b6903b845a143509db64291", "attempt_id": "d104158b2fd8", "run_group_id": "ED_hosted_pilot:A0|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:12.707644Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": null} | |
| 6 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "032b6e4875944e1191af2d54", "attempt_id": "d4eaa7013477", "run_group_id": "ED_hosted_pilot:A1|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:12.734880Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 7 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "4eacf66d98b622bc44b13565", "attempt_id": "d95ede994be4", "run_group_id": "ED_hosted_pilot:A1|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:12.762015Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 8 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "063134d62281ca8330f2b85e", "attempt_id": "1025dfb58ef3", "run_group_id": "ED_hosted_pilot:A1|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:12.789169Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 9 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "bdbcae7fdaa7fe01814d03e0", "attempt_id": "0b129eea6fdc", "run_group_id": "ED_hosted_pilot:A1|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:12.816594Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 10 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "75e89070305ae6a05b5d5e73", "attempt_id": "69ef51a2d456", "run_group_id": "ED_hosted_pilot:A1|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:12.843271Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 11 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "d464bc69b756f159c5353d0d", "attempt_id": "9f5c13ae7a02", "run_group_id": "ED_hosted_pilot:A1|anthropic|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:12.870251Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 12 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "a989a740dd1619c7db0f5527", "attempt_id": "37b117f6672e", "run_group_id": "ED_hosted_pilot:A1|anthropic|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:12.898037Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 13 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "ca0d76b981f44c40c4ad4fc1", "attempt_id": "8a885b21d2f2", "run_group_id": "ED_hosted_pilot:A1|anthropic|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:12.927053Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 14 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "74e77c817ea583eee42d67bb", "attempt_id": "d9296e52ecb3", "run_group_id": "ED_hosted_pilot:A1|anthropic|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:12.956942Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 15 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "a3475b0cf5e69dfa7e07da4b", "attempt_id": "b693419883a1", "run_group_id": "ED_hosted_pilot:A1|anthropic|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:12.984419Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 16 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "4def82cabd56b5e1d5ae0be7", "attempt_id": "67f9678fdc3c", "run_group_id": "ED_hosted_pilot:A4|anthropic|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:57.409047Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind"}, "question_access": "blind", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 44384.54095798079}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {"sender_input_tokens": 2087, "sender_output_tokens": 512, "sender_prefill_ms": 8257.009375025518, "sender_ttft_ms": 752.8658750234172, "sender_decode_ms": 35372.211750014685}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": null} | |
| 17 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "895d347893a15bd2e25ecdc8", "attempt_id": "5a978d2e0d13", "run_group_id": "ED_hosted_pilot:A4|anthropic|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:57.442339Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind"}, "question_access": "blind", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 44384.54095798079}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {"sender_input_tokens": 2087, "sender_output_tokens": 512, "sender_prefill_ms": 8257.009375025518, "sender_ttft_ms": 752.8658750234172, "sender_decode_ms": 35372.211750014685}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": null} | |
| 18 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "efdb1fcae5380a8ebd2193cf", "attempt_id": "d3b5a004fc6f", "run_group_id": "ED_hosted_pilot:A4|anthropic|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:57.462266Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind"}, "question_access": "blind", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 44384.54095798079}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {"sender_input_tokens": 2087, "sender_output_tokens": 512, "sender_prefill_ms": 8257.009375025518, "sender_ttft_ms": 752.8658750234172, "sender_decode_ms": 35372.211750014685}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": null} | |
| 19 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "ed16ba734ce16bb0e4060632", "attempt_id": "f151bd2a0182", "run_group_id": "ED_hosted_pilot:A4|anthropic|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:57.482159Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind"}, "question_access": "blind", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 44384.54095798079}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {"sender_input_tokens": 2087, "sender_output_tokens": 512, "sender_prefill_ms": 8257.009375025518, "sender_ttft_ms": 752.8658750234172, "sender_decode_ms": 35372.211750014685}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": null} | |
| 20 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "b15a221d0cd82eb0aace4ef1", "attempt_id": "8418608d1339", "run_group_id": "ED_hosted_pilot:A4|anthropic|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:52:57.502151Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind"}, "question_access": "blind", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 44384.54095798079}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {"sender_input_tokens": 2087, "sender_output_tokens": 512, "sender_prefill_ms": 8257.009375025518, "sender_ttft_ms": 752.8658750234172, "sender_decode_ms": 35372.211750014685}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": null} | |
| 21 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "2dc390758219ee06b9b86e03", "attempt_id": "e32976e3b840", "run_group_id": "ED_hosted_pilot:A5|anthropic|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:36.692035Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind"}, "question_access": "blind", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 39143.36820796598}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {"sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 1985.75779190287, "sender_ttft_ms": 84.91991693153977, "sender_decode_ms": 37040.277417050675}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "448fbefbbf3dc2a8c9785c435f1c717947c9d692820d830c64b908b542a8566e", "output_hash": null} | |
| 22 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "1fe853671a33d247f527f99b", "attempt_id": "09678cb3e11b", "run_group_id": "ED_hosted_pilot:A5|anthropic|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:36.756016Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind"}, "question_access": "blind", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 39143.36820796598}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {"sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 1985.75779190287, "sender_ttft_ms": 84.91991693153977, "sender_decode_ms": 37040.277417050675}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "448fbefbbf3dc2a8c9785c435f1c717947c9d692820d830c64b908b542a8566e", "output_hash": null} | |
| 23 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "77f7a2368c6f416171eed051", "attempt_id": "f06cadaf8e81", "run_group_id": "ED_hosted_pilot:A5|anthropic|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:36.783971Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind"}, "question_access": "blind", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 39143.36820796598}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {"sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 1985.75779190287, "sender_ttft_ms": 84.91991693153977, "sender_decode_ms": 37040.277417050675}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "448fbefbbf3dc2a8c9785c435f1c717947c9d692820d830c64b908b542a8566e", "output_hash": null} | |
| 24 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "428c3e3809ba54771be278c0", "attempt_id": "1be28ac7a707", "run_group_id": "ED_hosted_pilot:A5|anthropic|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:36.807615Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind"}, "question_access": "blind", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 39143.36820796598}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {"sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 1985.75779190287, "sender_ttft_ms": 84.91991693153977, "sender_decode_ms": 37040.277417050675}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "448fbefbbf3dc2a8c9785c435f1c717947c9d692820d830c64b908b542a8566e", "output_hash": null} | |
| 25 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "bf80f2d2da6796cf23ede2c9", "attempt_id": "4b6c96c90947", "run_group_id": "ED_hosted_pilot:A5|anthropic|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:36.833122Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind"}, "question_access": "blind", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 39143.36820796598}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {"sender_input_tokens": 2115, "sender_output_tokens": 512, "sender_prefill_ms": 1985.75779190287, "sender_ttft_ms": 84.91991693153977, "sender_decode_ms": 37040.277417050675}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "448fbefbbf3dc2a8c9785c435f1c717947c9d692820d830c64b908b542a8566e", "output_hash": null} | |
| 26 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "bbe4530230eb2e3644c3c1dc", "attempt_id": "a82819d75c3d", "run_group_id": "ED_hosted_pilot:A0|openai|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:36.860021Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "gpt-5-nano-2025-08-07", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:openai", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 1509.8056249553338, "ttft_ms": null}, "total_wall_ms": 1509.8056249553338, "ttft_ms": null, "input_usage": {"provider_input_tokens": 61}, "output_usage": {"provider_output_tokens": 19}, "provider_cached_usage": {"cached_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 1.065e-05, "kind": "estimated", "price_source": "openai.com/api/pricing, as known 2026-10 (verify)", "model": "gpt-5-nano-2025-08-07"}, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 27 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "90c543b7ace9133edaa20358", "attempt_id": "1f41614464f8", "run_group_id": "ED_hosted_pilot:A0|openai|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:38.416032Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "gpt-5-nano-2025-08-07", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:openai", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 1078.1314589548856, "ttft_ms": null}, "total_wall_ms": 1078.1314589548856, "ttft_ms": null, "input_usage": {"provider_input_tokens": 66}, "output_usage": {"provider_output_tokens": 19}, "provider_cached_usage": {"cached_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 1.09e-05, "kind": "estimated", "price_source": "openai.com/api/pricing, as known 2026-10 (verify)", "model": "gpt-5-nano-2025-08-07"}, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 28 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "f685c8236370bfb34a1b7ba9", "attempt_id": "fb8bb5251be5", "run_group_id": "ED_hosted_pilot:A0|openai|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:39.530815Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "gpt-5-nano-2025-08-07", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:openai", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 1124.6261249762028, "ttft_ms": null}, "total_wall_ms": 1124.6261249762028, "ttft_ms": null, "input_usage": {"provider_input_tokens": 66}, "output_usage": {"provider_output_tokens": 19}, "provider_cached_usage": {"cached_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 1.09e-05, "kind": "estimated", "price_source": "openai.com/api/pricing, as known 2026-10 (verify)", "model": "gpt-5-nano-2025-08-07"}, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 29 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "c59ffac231263b20d32c7367", "attempt_id": "e270dc24e5d9", "run_group_id": "ED_hosted_pilot:A0|openai|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:40.881226Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "gpt-5-nano-2025-08-07", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:openai", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 1342.088875011541, "ttft_ms": null}, "total_wall_ms": 1342.088875011541, "ttft_ms": null, "input_usage": {"provider_input_tokens": 63}, "output_usage": {"provider_output_tokens": 19}, "provider_cached_usage": {"cached_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 1.075e-05, "kind": "estimated", "price_source": "openai.com/api/pricing, as known 2026-10 (verify)", "model": "gpt-5-nano-2025-08-07"}, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 30 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "8e8ce85170ddad04c92cab9a", "attempt_id": "03232d96d244", "run_group_id": "ED_hosted_pilot:A0|openai|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:42.355479Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "gpt-5-nano-2025-08-07", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:openai", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 708.8305000215769, "ttft_ms": null}, "total_wall_ms": 708.8305000215769, "ttft_ms": null, "input_usage": {"provider_input_tokens": 69}, "output_usage": {"provider_output_tokens": 19}, "provider_cached_usage": {"cached_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 1.1050000000000001e-05, "kind": "estimated", "price_source": "openai.com/api/pricing, as known 2026-10 (verify)", "model": "gpt-5-nano-2025-08-07"}, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 31 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "0e01946124b078a492937cc0", "attempt_id": "d418850bdcbd", "run_group_id": "ED_hosted_pilot:A1|openai|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:43.089282Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "gpt-5-nano-2025-08-07", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:openai", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 1212.2819590149447, "ttft_ms": null}, "total_wall_ms": 1212.2819590149447, "ttft_ms": null, "input_usage": {"provider_input_tokens": 1814}, "output_usage": {"provider_output_tokens": 25}, "provider_cached_usage": {"cached_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 0.00010070000000000001, "kind": "estimated", "price_source": "openai.com/api/pricing, as known 2026-10 (verify)", "model": "gpt-5-nano-2025-08-07"}, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 32 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "5c19d88f67180b80d92d8032", "attempt_id": "8313483fc818", "run_group_id": "ED_hosted_pilot:A1|openai|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:44.326719Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "gpt-5-nano-2025-08-07", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:openai", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 967.2560839680955, "ttft_ms": null}, "total_wall_ms": 967.2560839680955, "ttft_ms": null, "input_usage": {"provider_input_tokens": 1819}, "output_usage": {"provider_output_tokens": 26}, "provider_cached_usage": {"cached_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 0.00010135000000000001, "kind": "estimated", "price_source": "openai.com/api/pricing, as known 2026-10 (verify)", "model": "gpt-5-nano-2025-08-07"}, "prediction_artifact": "Lot 61-C in Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "3491362e6ed6bb557ea2c25e29286d6fdbd0a0a36995d38446eddfd8450e097c"} | |
| 33 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "0086f567a42d4af0f28bd883", "attempt_id": "a4f1f997c705", "run_group_id": "ED_hosted_pilot:A1|openai|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:45.312979Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "gpt-5-nano-2025-08-07", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:openai", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 1130.8841250138357, "ttft_ms": null}, "total_wall_ms": 1130.8841250138357, "ttft_ms": null, "input_usage": {"provider_input_tokens": 1819}, "output_usage": {"provider_output_tokens": 22}, "provider_cached_usage": {"cached_tokens": 1664}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 2.487e-05, "kind": "estimated", "price_source": "openai.com/api/pricing, as known 2026-10 (verify)", "model": "gpt-5-nano-2025-08-07"}, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 34 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "3bd0654b84693558657547d2", "attempt_id": "4ce73db5d211", "run_group_id": "ED_hosted_pilot:A1|openai|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:46.465597Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "gpt-5-nano-2025-08-07", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:openai", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 729.9854580778629, "ttft_ms": null}, "total_wall_ms": 729.9854580778629, "ttft_ms": null, "input_usage": {"provider_input_tokens": 1816}, "output_usage": {"provider_output_tokens": 23}, "provider_cached_usage": {"cached_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 0.00010000000000000002, "kind": "estimated", "price_source": "openai.com/api/pricing, as known 2026-10 (verify)", "model": "gpt-5-nano-2025-08-07"}, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 35 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "6e8008b2f7246a185e29b5eb", "attempt_id": "719185eafc29", "run_group_id": "ED_hosted_pilot:A1|openai|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:47.215177Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "gpt-5-nano-2025-08-07", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:openai", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 982.3185830609873, "ttft_ms": null}, "total_wall_ms": 982.3185830609873, "ttft_ms": null, "input_usage": {"provider_input_tokens": 1822}, "output_usage": {"provider_output_tokens": 24}, "provider_cached_usage": {"cached_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 0.00010070000000000002, "kind": "estimated", "price_source": "openai.com/api/pricing, as known 2026-10 (verify)", "model": "gpt-5-nano-2025-08-07"}, "prediction_artifact": "6,889,172 NOK", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.6666666666666666}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "ce5dae2b035af8d38bda9e7d1f1cb7eb7e4141e20298d86d8bce5fe5ac6c0246"} | |
| 36 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "b3d76c8d76f16e58b1a4b19b", "attempt_id": "13025e86c5c9", "run_group_id": "ED_hosted_pilot:A1|openai|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:48.216255Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "gpt-5-nano-2025-08-07", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:openai", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 814.3011669162661, "ttft_ms": null}, "total_wall_ms": 814.3011669162661, "ttft_ms": null, "input_usage": {"provider_input_tokens": 1814}, "output_usage": {"provider_output_tokens": 25}, "provider_cached_usage": {"cached_tokens": 1664}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 2.582e-05, "kind": "estimated", "price_source": "openai.com/api/pricing, as known 2026-10 (verify)", "model": "gpt-5-nano-2025-08-07"}, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 37 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "42afd2cbda091e859912bd8d", "attempt_id": "dfcf2641b335", "run_group_id": "ED_hosted_pilot:A1|openai|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:49.051897Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "gpt-5-nano-2025-08-07", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:openai", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 1184.6378340851516, "ttft_ms": null}, "total_wall_ms": 1184.6378340851516, "ttft_ms": null, "input_usage": {"provider_input_tokens": 1819}, "output_usage": {"provider_output_tokens": 26}, "provider_cached_usage": {"cached_tokens": 1664}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 2.647e-05, "kind": "estimated", "price_source": "openai.com/api/pricing, as known 2026-10 (verify)", "model": "gpt-5-nano-2025-08-07"}, "prediction_artifact": "Lot 61-C in Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "3491362e6ed6bb557ea2c25e29286d6fdbd0a0a36995d38446eddfd8450e097c"} | |
| 38 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "4678ee5a3a08fb39262aca8d", "attempt_id": "298d6c2cf0ae", "run_group_id": "ED_hosted_pilot:A1|openai|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:50.255953Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "gpt-5-nano-2025-08-07", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:openai", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 778.2581249484792, "ttft_ms": null}, "total_wall_ms": 778.2581249484792, "ttft_ms": null, "input_usage": {"provider_input_tokens": 1819}, "output_usage": {"provider_output_tokens": 22}, "provider_cached_usage": {"cached_tokens": 1664}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 2.487e-05, "kind": "estimated", "price_source": "openai.com/api/pricing, as known 2026-10 (verify)", "model": "gpt-5-nano-2025-08-07"}, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 39 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "31adea242c957a2fd31d6c51", "attempt_id": "b38ae3d8252d", "run_group_id": "ED_hosted_pilot:A1|openai|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:51.056746Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "gpt-5-nano-2025-08-07", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:openai", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 872.2695419564843, "ttft_ms": null}, "total_wall_ms": 872.2695419564843, "ttft_ms": null, "input_usage": {"provider_input_tokens": 1816}, "output_usage": {"provider_output_tokens": 23}, "provider_cached_usage": {"cached_tokens": 1664}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 2.5120000000000003e-05, "kind": "estimated", "price_source": "openai.com/api/pricing, as known 2026-10 (verify)", "model": "gpt-5-nano-2025-08-07"}, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 40 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "621830b97e9afd1f4239bab8", "attempt_id": "a94b55152a78", "run_group_id": "ED_hosted_pilot:A1|openai|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": "c1d4b3900e40473a307dd7a405fffb0fb01ebc3b", "timestamp_utc": "2026-10-30T03:53:51.956254Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "gpt-5-nano-2025-08-07", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:openai", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 755.436833947897, "ttft_ms": null}, "total_wall_ms": 755.436833947897, "ttft_ms": null, "input_usage": {"provider_input_tokens": 1822}, "output_usage": {"provider_output_tokens": 24}, "provider_cached_usage": {"cached_tokens": 1664}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 2.582e-05, "kind": "estimated", "price_source": "openai.com/api/pricing, as known 2026-10 (verify)", "model": "gpt-5-nano-2025-08-07"}, "prediction_artifact": "6,889,172 NOK", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.6666666666666666}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "ce5dae2b035af8d38bda9e7d1f1cb7eb7e4141e20298d86d8bce5fe5ac6c0246"} | |
modified
scripts/e6_network.py
+7 −1
@@ -16,7 +16,7 @@ from wp30.scoring import score_synthetic | ||
| 16 | 16 | ap = argparse.ArgumentParser() |
| 17 | 17 | ap.add_argument("--host", required=True); ap.add_argument("--port", type=int, default=9430); ap.add_argument("--model", default="qwen3b") |
| 18 | 18 | ap.add_argument("--docs", type=int, default=6); ap.add_argument("--lengths", type=int, nargs="+", default=[2000, 8000, 16000]); ap.add_argument("--repeats", type=int, default=3) |
| 19 | −ap.add_argument("--label", default=None); ap.add_argument("--split", default="dev"); ap.add_argument("--out", default="runs/raw/E6_network.jsonl") | |
| 19 | +ap.add_argument("--label", default=None); ap.add_argument("--warmup", type=int, default=1); ap.add_argument("--split", default="dev"); ap.add_argument("--out", default="runs/raw/E6_network.jsonl") | |
| 20 | 20 | a = ap.parse_args() |
| 21 | 21 | label = a.label or ("loopback" if a.host.startswith("127.") else "lan") |
| 22 | 22 | mcfg = yaml.safe_load(open(ROOT / "configs/models.yaml"))["models"] |
@@ -30,6 +30,12 @@ man = read_json(ROOT / "data/manifests/splits.json") | ||
| 30 | 30 | items = [it for it in man["items"] if it["family"] == "synthetic" and it["split"] == a.split and it.get("target_tokens") in a.lengths] |
| 31 | 31 | by_len = {L: [it for it in items if it["target_tokens"] == L][: a.docs] for L in a.lengths} |
| 32 | 32 | out = ROOT / a.out |
| 33 | +# warm-up: compile kernels on both ends (not recorded) | |
| 34 | +if a.warmup: | |
| 35 | + _w = m.chat_prompt_tokens([{"role": "user", "content": "warm up " * 200}]) | |
| 36 | + for _ in range(a.warmup): | |
| 37 | + _c, _ = m.prefill(_w); m.generate_from_cache(_c, _w[-3:], max_tokens=4); cl.call({"cmd": "run_text", "token_ids": _w, "max_tokens": 4}) | |
| 38 | + _man = build_manifest(m.info, _w, to_sparse_all(_c), "warm", "B1", {}); cl.call({"cmd": "run_cache", "codec": "none", "prefix_hash": _man["prefix_token_hash"], "query_ids": _w[-3:], "max_tokens": 4}, serialize_cache(to_sparse_all(_c), _man)) | |
| 33 | 39 | for L, its in by_len.items(): |
| 34 | 40 | for it in its: |
| 35 | 41 | doc = load_doc(it["document_id"], "synthetic"); key = load_key(it["document_id"], "synthetic") |
added
src/wp30/analysis/__init__.py
+0 −0
added
src/wp30/analysis/analyze.py
+250 −0
@@ -0,0 +1,250 @@ | ||
| 1 | +"""Build every empirical table and figure from raw records. Each output gets a provenance entry (source run files + script).""" | |
| 2 | +from __future__ import annotations | |
| 3 | +import json, sys, glob | |
| 4 | +from pathlib import Path | |
| 5 | +import numpy as np, pandas as pd | |
| 6 | +import matplotlib | |
| 7 | +matplotlib.use("Agg") | |
| 8 | +import matplotlib.pyplot as plt | |
| 9 | +from ..util import ROOT, read_json, write_json, read_jsonl, utc_now | |
| 10 | +from .load import load_experiments, LABELS | |
| 11 | +from .stats import cluster_bootstrap_mean, paired_difference, holm, summarize_latency | |
| 12 | + | |
| 13 | +# fixed hue per method family (colorblind-validated palette; see results/figures/PALETTE.txt) | |
| 14 | +PAL = {"A": "#2a78d6", "B_quant": "#eb6834", "B_sel": "#1baf7a", "B_ref": "#6250d6", "C": "#e87ba4", "A_struct": "#eda100", "neg": "#e34948", "hosted": "#008300"} | |
| 15 | +METHOD_COLOR = {"A0": "#7a7a78", "A1": "#2a78d6", "A2": "#2a78d6", "A3": "#2a78d6", "A4": "#2a78d6", "A5": "#eda100", "A6": "#eda100", "A7": "#2a78d6", "A8": "#2a78d6", | |
| 16 | + "B0": "#6250d6", "B1": "#6250d6", "B2": "#eb6834", "B3": "#1baf7a", "B4": "#e34948", "B5": "#1baf7a", "B6": "#1baf7a", "B9": "#eb6834", "C0": "#e34948", "C2": "#e87ba4", "C3": "#e87ba4"} | |
| 17 | +MARKER = {"A0": "x", "A1": "o", "A2": "v", "A3": "^", "A4": "s", "A5": "D", "A6": "P", "A7": "o", "A8": "<", "B0": "o", "B1": "o", "B2": "s", "B3": "^", "B4": "x", "B5": "D", "B6": "P", "B9": "*", "C0": "x", "C2": "s", "C3": "D"} | |
| 18 | +TAB = ROOT / "results/tables"; FIG = ROOT / "results/figures" | |
| 19 | +PROV: dict = {} | |
| 20 | + | |
| 21 | +def _prov(path: Path, sources: list[str], note: str = ""): | |
| 22 | + PROV[str(path.relative_to(ROOT))] = {"sources": sources, "script": "src/wp30/analysis/analyze.py", "generated_utc": utc_now(), "note": note} | |
| 23 | + | |
| 24 | +def _save_fig(fig, name: str, sources: list[str], note: str = ""): | |
| 25 | + FIG.mkdir(parents=True, exist_ok=True) | |
| 26 | + for ext in ("pdf", "png"): | |
| 27 | + p = FIG / f"{name}.{ext}"; fig.savefig(p, bbox_inches="tight", dpi=160 if ext == "png" else None) | |
| 28 | + _prov(p, sources, note) | |
| 29 | + plt.close(fig) | |
| 30 | + | |
| 31 | +def _style(): | |
| 32 | + plt.rcParams.update({"font.size": 9, "axes.spines.top": False, "axes.spines.right": False, "axes.grid": True, "grid.alpha": 0.25, "grid.linewidth": 0.5, | |
| 33 | + "legend.frameon": False, "figure.dpi": 110, "axes.titlesize": 9.5, "axes.labelsize": 9}) | |
| 34 | + | |
| 35 | +def fmt_bytes(b): | |
| 36 | + return f"{b/1e6:.1f} MB" if b >= 1e6 else (f"{b/1e3:.1f} kB" if b >= 1e3 else f"{b:.0f} B") | |
| 37 | + | |
| 38 | +# ------------------------------------------------------------------------------------------------------------- tables | |
| 39 | +def table_primary(df: pd.DataFrame, exp: str, sources: list[str]) -> pd.DataFrame: | |
| 40 | + rows = [] | |
| 41 | + for (fam, pair, cond), g in df.groupby(["task_family", "pair", "condition"]): | |
| 42 | + q = cluster_bootstrap_mean(g, "quality_operational"); ok = (g["status"] == "success").mean() | |
| 43 | + rows.append({"family": fam, "pair": pair, "condition": cond, "method": g["method_id"].iloc[0], "access": g["question_access"].iloc[0], "n": q["n"], "n_docs": q["n_clusters"], | |
| 44 | + "quality": q["mean"], "q_lo": q["lo"], "q_hi": q["hi"], "success_rate": ok, "payload_bytes_median": g["serialized_payload_bytes"].median(), | |
| 45 | + "cache_bytes_median": g["cache_tensor_bytes"].median(), "cold_ms_p50": g["cost_cold_ms"].median(), "warm_ms_p50": g["cost_warm_query_ms"].median(), | |
| 46 | + "amortized_ms_p50": g["cost_amortized_ms"].median(), "ttft_ms_p50": g["ttft_ms"].median(), "peak_decode_mem_median": g["peak_decode_memory"].median(), | |
| 47 | + "fetched_bytes_mean": g["fetched_bytes"].mean()}) | |
| 48 | + t = pd.DataFrame(rows).sort_values(["family", "pair", "condition"]) | |
| 49 | + TAB.mkdir(parents=True, exist_ok=True); p = TAB / f"{exp}_primary.csv"; t.to_csv(p, index=False); _prov(p, sources, "per-condition quality (cluster bootstrap CI) and resource medians") | |
| 50 | + return t | |
| 51 | + | |
| 52 | +def table_failures(df: pd.DataFrame, exp: str, sources): | |
| 53 | + t = df.groupby(["method_id", "status"]).size().unstack(fill_value=0) | |
| 54 | + p = TAB / f"{exp}_failures.csv"; t.to_csv(p); _prov(p, sources, "attempt status counts by method"); return t | |
| 55 | + | |
| 56 | +def table_qtype(df: pd.DataFrame, exp: str, sources): | |
| 57 | + d = df[df["task_family"] == "synthetic"] | |
| 58 | + rows = [] | |
| 59 | + for (cond, qt), g in d.groupby(["condition", "qtype"]): | |
| 60 | + q = cluster_bootstrap_mean(g, "quality_operational", n_boot=500); rows.append({"condition": cond, "qtype": qt, "quality": q["mean"], "lo": q["lo"], "hi": q["hi"], "n": q["n"]}) | |
| 61 | + t = pd.DataFrame(rows); p = TAB / f"{exp}_by_question_type.csv"; t.to_csv(p, index=False); _prov(p, sources, "synthetic accuracy by question type"); return t | |
| 62 | + | |
| 63 | +def primary_tests(df: pd.DataFrame, exp: str, sources, tests: list[dict]): | |
| 64 | + rows = [] | |
| 65 | + for t in tests: | |
| 66 | + sub = df[df["task_family"].isin(t["families"])] if t.get("families") else df | |
| 67 | + if t.get("pair"): sub = sub[sub["pair"] == t["pair"]] | |
| 68 | + r = paired_difference(sub, t.get("value", "quality_operational"), "condition", t["a"], t["b"], keys=("document_id", "question_id", "pair")) | |
| 69 | + r.update({"name": t["name"], "hypothesis": t.get("hypothesis", "")}); rows.append(r) | |
| 70 | + out = pd.DataFrame(rows) | |
| 71 | + if len(out): | |
| 72 | + out["p_holm"] = holm([p if not np.isnan(p) else 1.0 for p in out["p"]]) | |
| 73 | + p = TAB / f"{exp}_primary_tests.csv"; out.to_csv(p, index=False); _prov(p, sources, "registered primary comparisons, paired, cluster bootstrap, Holm"); return out | |
| 74 | + | |
| 75 | +# ------------------------------------------------------------------------------------------------------------ figures | |
| 76 | +def fig_quality_vs_bytes(df: pd.DataFrame, exp: str, sources, access_filter=None, name="fig2_quality_vs_bytes"): | |
| 77 | + _style() | |
| 78 | + fams = [f for f in ["synthetic", "exec", "public_qasper", "public_2wikimqa"] if f in set(df["task_family"])] | |
| 79 | + pairs = sorted(df["pair"].unique()) | |
| 80 | + fig, axes = plt.subplots(len(pairs), len(fams), figsize=(3.1 * len(fams), 2.7 * len(pairs)), squeeze=False, sharey="row") | |
| 81 | + for i, pair in enumerate(pairs): | |
| 82 | + for j, fam in enumerate(fams): | |
| 83 | + ax = axes[i][j]; d = df[(df["pair"] == pair) & (df["task_family"] == fam)] | |
| 84 | + if access_filter: d = d[d["question_access"].isin(access_filter)] | |
| 85 | + for cond, g in d.groupby("condition"): | |
| 86 | + m = g["method_id"].iloc[0]; q = cluster_bootstrap_mean(g, "quality_operational", n_boot=300) | |
| 87 | + x = g["serialized_payload_bytes"].median() | |
| 88 | + if m == "A0" or x is None or np.isnan(x): continue | |
| 89 | + ax.errorbar(max(x, 1), q["mean"], yerr=[[q["mean"] - q["lo"]], [q["hi"] - q["mean"]]], fmt=MARKER.get(m, "o"), color=METHOD_COLOR.get(m, "#444"), ms=4.5, lw=0.9, capsize=1.5, mfc="white" if m.startswith("B") else None) | |
| 90 | + ax.set_xscale("log"); ax.set_title(f"{fam} · {pair}", fontsize=8.5); ax.set_ylim(-0.03, 1.03) | |
| 91 | + if i == len(pairs) - 1: ax.set_xlabel("serialized payload bytes (log)") | |
| 92 | + if j == 0: ax.set_ylabel("quality (acc. or F1)") | |
| 93 | + handles = [plt.Line2D([], [], marker=MARKER[m], color=METHOD_COLOR[m], ls="", ms=5, mfc="white" if m.startswith("B") else None, label=LABELS[m]) for m in ["A1", "A2", "A3", "A4", "A5", "A6", "A7", "A8", "B0", "B1", "B2", "B3", "B4", "B5", "B6", "B9", "C0", "C2", "C3"] if m in set(df["method_id"])] | |
| 94 | + fig.legend(handles=handles, loc="lower center", ncol=5, fontsize=7, bbox_to_anchor=(0.5, -0.06 - 0.02 * (len(handles) // 5))) | |
| 95 | + fig.suptitle("Quality vs measured serialized payload bytes (medians; 95% cluster-bootstrap CIs)", fontsize=9.5, y=1.0) | |
| 96 | + _save_fig(fig, name, sources, "points = conditions; x = median payload bytes; y = mean quality") | |
| 97 | + | |
| 98 | +def fig_quality_vs_latency(df: pd.DataFrame, exp: str, sources, name="fig3_quality_vs_latency_memory"): | |
| 99 | + _style() | |
| 100 | + fams = [f for f in ["synthetic", "exec", "public_qasper", "public_2wikimqa"] if f in set(df["task_family"])] | |
| 101 | + fig, axes = plt.subplots(2, len(fams), figsize=(3.1 * len(fams), 5.2), squeeze=False) | |
| 102 | + for j, fam in enumerate(fams): | |
| 103 | + d = df[df["task_family"] == fam] | |
| 104 | + for cond, g in d.groupby("condition"): | |
| 105 | + m = g["method_id"].iloc[0]; q = g["quality_operational"].mean() | |
| 106 | + if m == "A0": continue | |
| 107 | + axes[0][j].scatter(g["cost_cold_ms"].median(), q, marker=MARKER.get(m, "o"), color=METHOD_COLOR.get(m, "#444"), s=22, facecolors="white" if m.startswith("B") else METHOD_COLOR.get(m, "#444"), lw=0.9) | |
| 108 | + axes[1][j].scatter(g["peak_decode_memory"].median() / 1e9, q, marker=MARKER.get(m, "o"), color=METHOD_COLOR.get(m, "#444"), s=22, facecolors="white" if m.startswith("B") else METHOD_COLOR.get(m, "#444"), lw=0.9) | |
| 109 | + axes[0][j].set_xscale("log"); axes[0][j].set_title(fam, fontsize=8.5); axes[0][j].set_xlabel("cold end-to-end latency, ms (log)"); axes[1][j].set_xlabel("peak MLX memory during trial, GB") | |
| 110 | + axes[0][j].set_ylim(-0.03, 1.03); axes[1][j].set_ylim(-0.03, 1.03) | |
| 111 | + axes[0][0].set_ylabel("quality"); axes[1][0].set_ylabel("quality") | |
| 112 | + fig.suptitle("Quality vs cold latency (top) and peak memory (bottom); all model pairs pooled", fontsize=9.5) | |
| 113 | + _save_fig(fig, name, sources) | |
| 114 | + | |
| 115 | +def fig_latency_decomposition(df: pd.DataFrame, exp: str, sources, name="fig4_latency_decomposition"): | |
| 116 | + _style() | |
| 117 | + d = df[(df["task_family"] == "synthetic") & (df["status"] == "success")] | |
| 118 | + conds = [c for c in ["A1", "A4|budget_tokens=512|blind", "A5|budget_tokens=512|blind", "A7|codec=zstd", "B0", "B1", "B2|bits=8", "B3|keep_frac=0.25", "B5|keep_frac=0.25|aware"] if c in set(d["condition"])] | |
| 119 | + comps = [("span_encode_ms", "sender encode (text)"), ("span_doc_prefill_ms", "document prefill (cache)"), ("span_compress_ms", "compress/select"), ("span_serialize_ms", "serialize"), ("span_load_ms", "deserialize/load"), ("span_receiver_prefill_ms", "receiver prefill"), ("ttft_ms", "query prefill→first token"), ("span_decode_ms", "decode")] | |
| 120 | + cols = ["#2a78d6", "#6250d6", "#1baf7a", "#eda100", "#e87ba4", "#eb6834", "#008300", "#7a7a78"] | |
| 121 | + fig, ax = plt.subplots(figsize=(7.2, 3.2)) | |
| 122 | + for i, c in enumerate(conds): | |
| 123 | + g = d[d["condition"] == c]; left = 0 | |
| 124 | + for (col, lab), color in zip(comps, cols): | |
| 125 | + v = g[col].median() if col in g and g[col].notna().any() else 0.0 | |
| 126 | + if v and v > 0: | |
| 127 | + ax.barh(i, v, left=left, color=color, height=0.6, label=lab if i == 0 else None, edgecolor="white", linewidth=0.8); left += v | |
| 128 | + ax.set_yticks(range(len(conds))); ax.set_yticklabels([c.replace("|", " ") for c in conds], fontsize=7.5); ax.invert_yaxis(); ax.set_xlabel("median span duration, ms (serial accounting; one question per document build)") | |
| 129 | + ax.legend(fontsize=7, ncol=4, loc="lower right"); ax.set_title("Latency decomposition — synthetic, cold scenario (document build counted once)", fontsize=9) | |
| 130 | + _save_fig(fig, name, sources) | |
| 131 | + | |
| 132 | +def fig_handoffs(df: pd.DataFrame, exp: str, sources, name="fig5_handoffs"): | |
| 133 | + _style() | |
| 134 | + d = df[df["topology"].astype(str).str.startswith("chain")] | |
| 135 | + if d.empty: return | |
| 136 | + fig, axes = plt.subplots(1, 3, figsize=(9.6, 2.8)) | |
| 137 | + for cid, g in d.groupby("run_group_id"): | |
| 138 | + pass | |
| 139 | + d["chain"] = d["run_group_id"].str.split(":").str[1] | |
| 140 | + for chain, g in d.groupby("chain"): | |
| 141 | + rep = g["method_id"].iloc[0]; mode = g["topology"].iloc[0].replace("chain_", "") | |
| 142 | + color = "#eda100" if rep == "A5" else "#2a78d6"; ls = "-" if mode == "closed" else "--" | |
| 143 | + hop = g.groupby("handoff_index") | |
| 144 | + ret = hop["retention_rate"].mean(); uns = hop["unsupported"].mean(); acc = hop["quality_operational"].mean() | |
| 145 | + axes[0].plot(ret.index, ret.values, ls, color=color, marker="o", ms=4, label=f"{rep} {mode}") | |
| 146 | + axes[1].plot(uns.index, uns.values, ls, color=color, marker="o", ms=4) | |
| 147 | + axes[2].plot(acc.index, acc.values, ls, color=color, marker="o", ms=4) | |
| 148 | + for ax, t in zip(axes, ["retained correct facts (ledger)", "unsupported numbers + identifiers per message", "question accuracy from message"]): | |
| 149 | + ax.set_xlabel("handoffs"); ax.set_title(t, fontsize=8.5); ax.set_xticks(sorted(d["handoff_index"].unique())) | |
| 150 | + axes[0].set_ylim(0, 1.02); axes[2].set_ylim(0, 1.02); axes[0].legend(fontsize=7) | |
| 151 | + _save_fig(fig, name, sources, "means over documents; chains defined in configs/chains*.yaml") | |
| 152 | + | |
| 153 | +def fig_breakeven(net_rows: list[dict], exp: str, sources, name="fig6_breakeven"): | |
| 154 | + """Measured two-node transfer vs remote text prefill; modeled curves from measured bandwidth.""" | |
| 155 | + _style() | |
| 156 | + if not net_rows: return | |
| 157 | + n = pd.DataFrame(net_rows) | |
| 158 | + fig, axes = plt.subplots(1, 2, figsize=(8.4, 3.0)) | |
| 159 | + ax = axes[0] | |
| 160 | + for (meth, bits, codec), g in n[n["method"] != "local_prefill"].groupby(["method", "bits", "codec"], dropna=False): | |
| 161 | + if meth == "text_remote_prefill": | |
| 162 | + tot = g["roundtrip_ms"]; lab = "text → remote prefill"; color = "#2a78d6"; mk = "o" | |
| 163 | + else: | |
| 164 | + tot = g["roundtrip_ms"]; lab = f"{meth}" + (f" {int(bits)}-bit" if pd.notna(bits) else "") + (f" +{codec}" if codec != "none" else ""); color = "#eb6834" if pd.notna(bits) else "#6250d6"; mk = "s" if pd.notna(bits) else "D" | |
| 165 | + gg = g.groupby("prefix_tokens")["roundtrip_ms"].median() | |
| 166 | + ax.plot(gg.index, gg.values, marker=mk, ms=4, color=color, lw=1, label=lab, alpha=0.9 if codec == "none" else 0.55, ls="-" if codec == "none" else ":") | |
| 167 | + ax.set_xlabel("context tokens"); ax.set_ylabel("remote answer round trip, ms (measured)"); ax.set_title("Measured: M3U96a → M3U96b, 1 GbE", fontsize=8.5); ax.legend(fontsize=6.5) | |
| 168 | + ax = axes[1] | |
| 169 | + bw = n[n["method"].isin(["B1", "B2"])]["effective_gbps"].median() | |
| 170 | + L = np.linspace(500, 32000, 50) | |
| 171 | + for bits, bpp in [(16, 2), (8, 1.07), (4, 0.57)]: | |
| 172 | + pass | |
| 173 | + # bytes per token measured from B1 rows (Qwen3B) | |
| 174 | + b1 = n[(n["method"] == "B1") & (n["codec"] == "none")] | |
| 175 | + bpt = (b1["serialized_bytes"] / b1["prefix_tokens"]).median() if len(b1) else np.nan | |
| 176 | + tr = n[n["method"] == "text_remote_prefill"] | |
| 177 | + if len(tr) and not np.isnan(bpt): | |
| 178 | + slope = (tr["remote_prefill_ms"] / tr["prefix_tokens"]).median() | |
| 179 | + for frac, lab, color in [(1.0, "bf16 cache", "#6250d6"), (0.53, "8-bit", "#eb6834"), (0.28, "4-bit", "#eb6834")]: | |
| 180 | + for bw_g, ls in [(bw, "-"), (10.0, "--")]: | |
| 181 | + t_ms = L * bpt * frac * 8 / (bw_g * 1e9) * 1000 | |
| 182 | + ax.plot(L, t_ms, ls, color=color, lw=1, alpha=0.9 if ls == "-" else 0.5, label=f"{lab} transfer @ {bw_g:.1f} Gb/s" if True else None) | |
| 183 | + ax.plot(L, L * slope, "-", color="#2a78d6", lw=1.5, label="remote text prefill (measured slope)") | |
| 184 | + ax.set_xlabel("context tokens"); ax.set_ylabel("ms"); ax.set_title("Modeled from measured bandwidth and prefill slope", fontsize=8.5); ax.legend(fontsize=6, ncol=2) | |
| 185 | + _save_fig(fig, name, sources, "left = measured; right = analytic model (dashed 10 Gb/s is hypothetical)") | |
| 186 | + | |
| 187 | +# ------------------------------------------------------------------------------------------------------------ main | |
| 188 | +def main(protocol_path: str) -> int: | |
| 189 | + _style() | |
| 190 | + prot = read_json(ROOT / protocol_path) if (ROOT / protocol_path).exists() else {} | |
| 191 | + core_exp = prot.get("core_experiment_ids", ["E1_core"]) if prot else ["E1_core"] | |
| 192 | + exps = {p.stem: p.name for p in (ROOT / "runs/raw").glob("*.jsonl")} | |
| 193 | + (FIG).mkdir(parents=True, exist_ok=True); (TAB).mkdir(parents=True, exist_ok=True) | |
| 194 | + (FIG / "PALETTE.txt").write_text("categorical palette validated with dataviz validate_palette.js (light): #2a78d6,#eb6834,#1baf7a,#eda100,#e87ba4,#008300,#6250d6,#e34948 — ALL CHECKS PASS\n") | |
| 195 | + # choose the experiment set to analyze: core if present, else pilot | |
| 196 | + main_exp = "E1_core" if "E1_core" in exps else ("E1_pilot" if "E1_pilot" in exps else None) | |
| 197 | + if main_exp: | |
| 198 | + src = [f"runs/raw/{main_exp}.jsonl"] | |
| 199 | + df = load_experiments([f"{main_exp}.jsonl"]) | |
| 200 | + table_primary(df, main_exp, src); table_failures(df, main_exp, src); table_qtype(df, main_exp, src) | |
| 201 | + tests = [ | |
| 202 | + {"name": "T1 A5 vs A4 (512, blind, synthetic)", "a": "A5|budget_tokens=512|blind", "b": "A4|budget_tokens=512|blind", "families": ["synthetic"], "hypothesis": "RQ5/H1"}, | |
| 203 | + {"name": "T2 B2-8bit vs B0", "a": "B2|bits=8", "b": "B0", "hypothesis": "H2"}, | |
| 204 | + {"name": "T3 B2-4bit vs B0", "a": "B2|bits=4", "b": "B0", "hypothesis": "H2"}, | |
| 205 | + {"name": "T4 B5-aware vs B3 (1/4)", "a": "B5|keep_frac=0.25|aware", "b": "B3|keep_frac=0.25", "hypothesis": "H3"}, | |
| 206 | + {"name": "T6 A1 vs B0 (text vs native cache, same content)", "a": "A1", "b": "B0", "hypothesis": "consistency"}, | |
| 207 | + ] | |
| 208 | + primary_tests(df, main_exp, src, tests) | |
| 209 | + fig_quality_vs_bytes(df, main_exp, src) | |
| 210 | + fig_quality_vs_bytes(df[df["question_access"].isin(["blind", "none"])], main_exp, src, name="figA_quality_vs_bytes_blind") | |
| 211 | + fig_quality_vs_bytes(df[df["question_access"] == "aware"], main_exp, src, name="figA_quality_vs_bytes_aware") | |
| 212 | + fig_quality_vs_latency(df, main_exp, src); fig_latency_decomposition(df, main_exp, src) | |
| 213 | + chain_exp = "E4_core" if "E4_core" in exps else ("E4_pilot" if "E4_pilot" in exps else None) | |
| 214 | + if chain_exp: | |
| 215 | + dfc = load_experiments([f"{chain_exp}.jsonl"]); src = [f"runs/raw/{chain_exp}.jsonl"] | |
| 216 | + fig_handoffs(dfc, chain_exp, src) | |
| 217 | + rows = [] | |
| 218 | + for (grp, h), g in dfc.groupby(["run_group_id", "handoff_index"]): | |
| 219 | + q = cluster_bootstrap_mean(g, "quality_operational", n_boot=500); r = cluster_bootstrap_mean(g.drop_duplicates("document_id"), "retention_rate", n_boot=500) | |
| 220 | + rows.append({"chain": grp.split(":")[1], "handoffs": h, "accuracy": q["mean"], "acc_lo": q["lo"], "acc_hi": q["hi"], "retention": r["mean"], "ret_lo": r["lo"], "ret_hi": r["hi"], | |
| 221 | + "unsupported_mean": g.drop_duplicates("document_id")["unsupported"].mean(), "fetched_bytes_mean": g["fetched_bytes"].mean(), "msg_bytes_mean": g["msg_bytes_hop"].mean(), "n": q["n"], "n_docs": q["n_clusters"]}) | |
| 222 | + t = pd.DataFrame(rows); p = TAB / f"{chain_exp}_handoffs.csv"; t.to_csv(p, index=False); _prov(p, src, "repeated handoffs") | |
| 223 | + primary_tests(dfc[dfc["handoff_index"] == 4].assign(condition=dfc["run_group_id"].str.split(":").str[1]), chain_exp + "_h4", src, | |
| 224 | + [{"name": "T5 A5 chain vs A4 chain at 4 handoffs (closed)", "a": "A5|closed|qwen3b", "b": "A4|closed|qwen3b", "hypothesis": "H5"}]) | |
| 225 | + fan_exp = "E5_core" if "E5_core" in exps else ("E5_pilot" if "E5_pilot" in exps else None) | |
| 226 | + if fan_exp: | |
| 227 | + dff = load_experiments([f"{fan_exp}.jsonl"]); src = [f"runs/raw/{fan_exp}.jsonl"] | |
| 228 | + rows = [] | |
| 229 | + for (cond, qt), g in dff.groupby(["condition", "qtype"]): | |
| 230 | + q = cluster_bootstrap_mean(g, "quality_operational", n_boot=500); rows.append({"condition": cond, "qtype": qt, "quality": q["mean"], "lo": q["lo"], "hi": q["hi"], "n": q["n"], "payload_bytes_median": g["serialized_payload_bytes"].median(), "fetched_bytes_mean": g["fetched_bytes"].mean()}) | |
| 231 | + t = pd.DataFrame(rows); p = TAB / f"{fan_exp}_fanin.csv"; t.to_csv(p, index=False); _prov(p, src, "fan-in by method and question type") | |
| 232 | + net_files = [p for p in (ROOT / "runs/raw").glob("E6_*.jsonl") if "smoke" not in p.name] or list((ROOT / "runs/raw").glob("E6_*.jsonl")) | |
| 233 | + if net_files: | |
| 234 | + rows = [r for p in net_files for r in read_jsonl(p)] | |
| 235 | + fig_breakeven(rows, "E6", [str(p.relative_to(ROOT)) for p in net_files]) | |
| 236 | + n = pd.DataFrame(rows) | |
| 237 | + agg = n.groupby(["label", "method", "bits", "codec", "target_tokens"], dropna=False).agg(n=("repeat", "size"), bytes=("serialized_bytes", "median"), roundtrip_ms_p50=("roundtrip_ms", "median"), send_ms_p50=("send_ms", "median"), | |
| 238 | + remote_load_ms_p50=("remote_load_ms", "median"), remote_ttft_p50=("remote_ttft_ms", "median"), remote_prefill_p50=("remote_prefill_ms", "median"), eff_gbps=("effective_gbps", "median"), correct=("correct", "mean")).reset_index() | |
| 239 | + p = TAB / "E6_network.csv"; agg.to_csv(p, index=False); _prov(p, [str(x.relative_to(ROOT)) for x in net_files], "two-node transfer measurements") | |
| 240 | + hosted = [p for p in (ROOT / "runs/raw").glob("ED_*.jsonl")] | |
| 241 | + if hosted: | |
| 242 | + dh = load_experiments([p.name for p in hosted]); src = [str(p.relative_to(ROOT)) for p in hosted] | |
| 243 | + rows = [] | |
| 244 | + for (fam, recv, cond), g in dh.groupby(["task_family", "receiver", "condition"]): | |
| 245 | + q = cluster_bootstrap_mean(g, "quality_operational", n_boot=500) | |
| 246 | + rows.append({"family": fam, "provider_model": recv, "condition": cond, "quality": q["mean"], "lo": q["lo"], "hi": q["hi"], "n": q["n"], "cost_usd_mean": g["cost_usd"].mean(), "ttft_ms_p50": g["ttft_ms"].median(), "total_ms_p50": g["total_wall_ms"].median(), "success_rate": (g["status"] == "success").mean()}) | |
| 247 | + t = pd.DataFrame(rows); p = TAB / "ED_hosted.csv"; t.to_csv(p, index=False); _prov(p, src, "hosted receivers; cost estimated from provider price tables") | |
| 248 | + write_json(ROOT / "results/provenance.json", PROV) | |
| 249 | + print(f"analysis done: {len(PROV)} artifacts with provenance") | |
| 250 | + return 0 | |
added
src/wp30/analysis/load.py
+74 −0
@@ -0,0 +1,74 @@ | ||
| 1 | +"""Load raw per-attempt records into a tidy DataFrame with derived columns (scenario costs, method labels).""" | |
| 2 | +from __future__ import annotations | |
| 3 | +import glob, json | |
| 4 | +import pandas as pd | |
| 5 | +import numpy as np | |
| 6 | +from ..util import ROOT, read_jsonl | |
| 7 | + | |
| 8 | +TEXT_METHODS = ["A0", "A1", "A2", "A3", "A4", "A5", "A6", "A7", "A8"] | |
| 9 | +CACHE_METHODS = ["B0", "B1", "B2", "B2b", "B3", "B4", "B5", "B6", "B9", "C0", "C2", "C3"] | |
| 10 | +LABELS = {"A0": "A0 no message", "A1": "A1 full text", "A2": "A2 head/tail", "A3": "A3 extractive", "A4": "A4 summary", "A5": "A5 structured evidence", "A6": "A6 refs+retrieval", | |
| 11 | + "A7": "A7 zstd text", "A8": "A8 LLMLingua-2", "B0": "B0 native cache", "B1": "B1 serialized reuse", "B2": "B2 packed quant", "B3": "B3 sink+recent", "B4": "B4 random", | |
| 12 | + "B5": "B5 attention (SnapKV-style)", "B6": "B6 pyramid", "B9": "B9 select+quant", "C0": "C0 identity (neg. control)", "C2": "C2 linear mapper", "C3": "C3 mapper+select"} | |
| 13 | + | |
| 14 | +def load_experiments(patterns: list[str]) -> pd.DataFrame: | |
| 15 | + rows = [] | |
| 16 | + for pat in patterns: | |
| 17 | + for p in glob.glob(str(ROOT / "runs/raw" / pat)): | |
| 18 | + for r in read_jsonl(p): | |
| 19 | + rows.append(flatten(r)) | |
| 20 | + df = pd.DataFrame(rows) | |
| 21 | + return df | |
| 22 | + | |
| 23 | +def _scenario_costs(r: dict) -> dict: | |
| 24 | + sp = r.get("timing_spans") or {} | |
| 25 | + m = r["method_id"] | |
| 26 | + enc = sp.get("encode_ms", 0.0) or 0.0 | |
| 27 | + recv = (sp.get("receiver_prefill_ms", 0.0) or 0.0) + (sp.get("ttft_ms", 0.0) or 0.0) + (sp.get("decode_ms", 0.0) or 0.0) | |
| 28 | + if m.startswith("B") or m.startswith("C"): | |
| 29 | + doc_prefill = sp.get("doc_prefill_ms", 0.0) or 0.0 | |
| 30 | + compress = (sp.get("compress_ms", 0.0) or 0.0) + (sp.get("serialize_ms", 0.0) or 0.0) | |
| 31 | + load = sp.get("load_ms", 0.0) or 0.0 | |
| 32 | + # cold: document must be read & cached, compressed, loaded, then query processed | |
| 33 | + cold = doc_prefill + compress + load + recv | |
| 34 | + # warm (cache already built & compressed once, reused across N queries): per-query = load + query | |
| 35 | + warm_query = load + recv | |
| 36 | + reuse_n = max(1, r.get("reuse_count") or 1) | |
| 37 | + amortized = (doc_prefill + compress) / reuse_n + warm_query | |
| 38 | + return {"cost_cold_ms": cold, "cost_warm_query_ms": warm_query, "cost_amortized_ms": amortized, "cost_build_ms": doc_prefill + compress, "receiver_ms": recv} | |
| 39 | + else: | |
| 40 | + reuse_n = max(1, r.get("reuse_count") or 1) | |
| 41 | + cold = enc + recv | |
| 42 | + warm_query = recv # message already built | |
| 43 | + amortized = enc / reuse_n + recv | |
| 44 | + return {"cost_cold_ms": cold, "cost_warm_query_ms": warm_query, "cost_amortized_ms": amortized, "cost_build_ms": enc, "receiver_ms": recv} | |
| 45 | + | |
| 46 | +def flatten(r: dict) -> dict: | |
| 47 | + sc = r.get("task_scores") or {} | |
| 48 | + cc = r.get("compression_config") or {} | |
| 49 | + out = {k: r.get(k) for k in ["experiment_id", "trial_id", "attempt_id", "run_group_id", "task_family", "document_id", "question_id", "split", "cluster_id", "method_id", | |
| 50 | + "question_access", "topology", "handoff_index", "reuse_count", "status", "error_code", "serialized_payload_bytes", "message_utf8_bytes", | |
| 51 | + "cache_tensor_bytes", "fetched_bytes", "total_wall_ms", "ttft_ms", "peak_prefill_memory", "peak_decode_memory", "prediction_artifact", "protocol_hash"]} | |
| 52 | + out["sender"] = (r.get("sender_model_revision") or "").split("@")[0].split("/")[-1] | |
| 53 | + out["receiver"] = (r.get("receiver_model_revision") or "").split("@")[0].split("/")[-1] | |
| 54 | + out["pair"] = f"{out['sender']}->{out['receiver']}" if out["sender"] else out["receiver"] | |
| 55 | + out["correct"] = sc.get("correct", np.nan); out["f1"] = sc.get("f1", np.nan); out["em"] = sc.get("em", np.nan); out["pass_rate"] = sc.get("pass_rate", np.nan); out["abstained"] = sc.get("abstained", np.nan) | |
| 56 | + out["quality"] = sc.get("f1") if r["task_family"].startswith("public_") else sc.get("correct") | |
| 57 | + if r["status"] != "success": | |
| 58 | + out["quality_operational"] = 0.0 | |
| 59 | + else: | |
| 60 | + out["quality_operational"] = out["quality"] | |
| 61 | + out["budget_tokens"] = cc.get("budget_tokens"); out["bits"] = cc.get("bits"); out["keep_frac"] = cc.get("keep_frac"); out["codec"] = cc.get("codec") | |
| 62 | + out["condition"] = r["run_group_id"].split(":", 1)[1] if ":" in (r.get("run_group_id") or "") else r["method_id"] | |
| 63 | + out["label"] = LABELS.get(r["method_id"], r["method_id"]) | |
| 64 | + out["qtype"] = r["question_id"].split("_", 1)[1] if "_" in r["question_id"] else r["task_family"] | |
| 65 | + ev = r.get("evidence_artifact") or {} | |
| 66 | + if isinstance(ev, dict) and "ledger" in ev: | |
| 67 | + L = ev["ledger"]; out["retention_rate"] = L["retention_rate"]; out["unsupported"] = L["unsupported_numbers"] + L["unsupported_identifiers"]; out["distorted"] = L["distorted_sentences"]; out["msg_bytes_hop"] = L["message_bytes"] | |
| 68 | + out.update(_scenario_costs(r)) | |
| 69 | + sp = r.get("timing_spans") or {} | |
| 70 | + for k in ["encode_ms", "doc_prefill_ms", "compress_ms", "serialize_ms", "load_ms", "receiver_prefill_ms", "query_prefill_ms", "decode_ms", "sender_prefill_ms"]: | |
| 71 | + out["span_" + k] = sp.get(k) | |
| 72 | + cost = r.get("cost_with_source") or {} | |
| 73 | + out["cost_usd"] = cost.get("usd") if isinstance(cost, dict) else None | |
| 74 | + return out | |
added
src/wp30/analysis/static_tables.py
+61 −0
@@ -0,0 +1,61 @@ | ||
| 1 | +"""Tables that depend on manifests/evidence rather than trial outcomes: taxonomy, models, datasets, coverage.""" | |
| 2 | +from __future__ import annotations | |
| 3 | +import json, pandas as pd | |
| 4 | +from pathlib import Path | |
| 5 | +from ..util import ROOT, read_json, write_json, utc_now | |
| 6 | + | |
| 7 | +TAB = ROOT / "results/tables" | |
| 8 | + | |
| 9 | +TAXONOMY = [ | |
| 10 | + # id, representation, access regime, training, compatibility, composable (fan-in), status | |
| 11 | + ("A0", "none (task only)", "n/a", "none", "any", "n/a", "measured"), | |
| 12 | + ("A1", "raw text", "blind", "none", "any receiver", "concatenation", "measured"), | |
| 13 | + ("A2", "text head/tail", "blind", "none", "any", "concatenation", "measured"), | |
| 14 | + ("A3", "extractive sentences (BM25/centrality)", "blind or aware", "none", "any", "concatenation", "measured"), | |
| 15 | + ("A4", "abstractive summary", "blind or aware", "none (prompted sender)", "any", "concatenation", "measured"), | |
| 16 | + ("A5", "typed facts + source spans + unknowns (JSON)", "blind or aware", "none (prompted sender)", "any", "record merge", "measured"), | |
| 17 | + ("A6", "reference index + metered retrieval", "blind index, aware retrieval", "none", "any + source access", "shared memory", "measured"), | |
| 18 | + ("A7", "raw text, zstd transport codec", "blind", "none", "any", "concatenation", "measured"), | |
| 19 | + ("A8", "LLMLingua-2 token dropping", "blind", "pretrained compressor (official)", "any", "concatenation", "measured"), | |
| 20 | + ("B0", "native bf16 KV cache", "blind", "none", "same checkpoint", "no", "measured"), | |
| 21 | + ("B1", "serialized KV cache (manifest-checked)", "blind", "none", "same checkpoint + revision", "no", "measured (process + 2-node)"), | |
| 22 | + ("B2", "packed quantized KV (8/4/2 bit)", "blind", "none", "same checkpoint", "no", "measured"), | |
| 23 | + ("B3", "sink+recent retention (StreamingLLM-inspired)", "blind", "none", "same checkpoint", "no", "measured"), | |
| 24 | + ("B4", "random retention (control)", "blind", "none", "same checkpoint", "no", "measured"), | |
| 25 | + ("B5", "attention-informed retention (SnapKV rule)", "aware (blind variant tested)", "none", "same checkpoint", "no", "measured"), | |
| 26 | + ("B6", "pyramid layer budgets (PyramidKV rule)", "aware", "none", "same checkpoint", "no", "measured"), | |
| 27 | + ("B9", "selection then packed quantization", "aware", "none", "same checkpoint", "no", "measured"), | |
| 28 | + ("C0", "sender cache fed as receiver cache", "blind", "none", "incompatible (negative control)", "no", "measured (control)"), | |
| 29 | + ("C2", "linear KV mapper (ridge, un-rotated K/V)", "blind", "ridge on train caches", "trained pair (Qwen 1.5B→3B)", "no", "measured"), | |
| 30 | + ("C3", "mapper + attention selection", "aware", "ridge on train caches", "trained pair", "no", "measured"), | |
| 31 | + ("—", "SwaT cross-family mapper", "blind", "~300M mapper (not public)", "Granite→SmolLM", "no", "not run: no checkpoint/licence"), | |
| 32 | + ("—", "Attention-Matching compaction", "blind", "none (optimization)", "same model", "no", "not run: CUDA/vLLM code; MLX port out of scope"), | |
| 33 | + ("—", "C2C fuser", "blind", "released fusers (Qwen3)", "Qwen3 receivers", "no", "not run: CUDA; receiver still prefills source"), | |
| 34 | + ("—", "H2O eviction", "cumulative", "none", "same checkpoint", "no", "not run: requires attention scores during whole prefill"), | |
| 35 | + ("—", "KIVI per-channel key quantization", "blind", "none", "same checkpoint", "no", "not run: CUDA kernels; motivation confirmed by B2 Qwen result"), | |
| 36 | +] | |
| 37 | + | |
| 38 | +def taxonomy(): | |
| 39 | + t = pd.DataFrame(TAXONOMY, columns=["id", "representation", "question_access", "training", "compatibility", "composable", "status_in_wp30"]) | |
| 40 | + t.to_csv(TAB / "table1_taxonomy.csv", index=False); return t | |
| 41 | + | |
| 42 | +def models(): | |
| 43 | + ev = read_json(ROOT / "evidence/models.json") | |
| 44 | + rows = [] | |
| 45 | + for alias, m in ev["models"].items(): | |
| 46 | + rows.append({"alias": alias, "repo": m["repo_id"], "revision": m["revision"][:12], "family": m["model_type"], "layers": m["num_layers"], "kv_heads": m["num_kv_heads"], "q_heads": m["num_attention_heads"], | |
| 47 | + "head_dim": m["head_dim"], "weights": m["weight_dtype"], "max_pos": m["max_position_embeddings"], "rope_theta": m["rope_theta"], "cache_bytes_per_token_bf16": 2 * m["num_layers"] * m["num_kv_heads"] * m["head_dim"] * 2, | |
| 48 | + "prefill_ms_8k": round(m["context_lengths"]["8192"]["prefill_ms"]), "prefill_ms_16k": round(m["context_lengths"]["16384"]["prefill_ms"]), "mlx": m["mlx_version"], "mlx_lm": m["mlx_lm_version"]}) | |
| 49 | + t = pd.DataFrame(rows); t.to_csv(TAB / "table2_models.csv", index=False); return t | |
| 50 | + | |
| 51 | +def datasets(): | |
| 52 | + man = read_json(ROOT / "data/manifests/splits.json"); df = pd.DataFrame(man["items"]) | |
| 53 | + g = df.groupby(["family", "split"]).agg(documents=("document_id", "count"), questions=("n_questions", "sum"), median_chars=("char_len", "median")).reset_index() | |
| 54 | + g.to_csv(TAB / "table3_datasets.csv", index=False); return g | |
| 55 | + | |
| 56 | +def main(): | |
| 57 | + TAB.mkdir(parents=True, exist_ok=True) | |
| 58 | + taxonomy(); models(); datasets(); print("static tables written") | |
| 59 | + | |
| 60 | +if __name__ == "__main__": | |
| 61 | + main() | |
added
src/wp30/analysis/stats.py
+51 −0
@@ -0,0 +1,51 @@ | ||
| 1 | +"""Paired, cluster-bootstrap statistics (cluster = document). Holm correction for the registered primary family.""" | |
| 2 | +from __future__ import annotations | |
| 3 | +import numpy as np | |
| 4 | +import pandas as pd | |
| 5 | + | |
| 6 | +def cluster_bootstrap_mean(df: pd.DataFrame, value: str, cluster: str = "document_id", n_boot: int = 2000, seed: int = 0, ci: float = 0.95) -> dict: | |
| 7 | + """Mean of `value` with a cluster bootstrap CI (resample documents with replacement; equal weight per observation).""" | |
| 8 | + d = df[[cluster, value]].dropna() | |
| 9 | + if d.empty: | |
| 10 | + return {"mean": np.nan, "lo": np.nan, "hi": np.nan, "n": 0, "n_clusters": 0} | |
| 11 | + groups = [g[value].to_numpy() for _, g in d.groupby(cluster)] | |
| 12 | + rng = np.random.default_rng(seed); G = len(groups) | |
| 13 | + sums = np.array([g.sum() for g in groups]); cnts = np.array([len(g) for g in groups]) | |
| 14 | + boots = np.empty(n_boot) | |
| 15 | + for b in range(n_boot): | |
| 16 | + idx = rng.integers(0, G, G) | |
| 17 | + boots[b] = sums[idx].sum() / cnts[idx].sum() | |
| 18 | + a = (1 - ci) / 2 | |
| 19 | + return {"mean": float(d[value].mean()), "lo": float(np.quantile(boots, a)), "hi": float(np.quantile(boots, 1 - a)), "n": int(len(d)), "n_clusters": int(G)} | |
| 20 | + | |
| 21 | +def paired_difference(df: pd.DataFrame, value: str, cond_col: str, a: str, b: str, keys=("document_id", "question_id", "pair"), cluster: str = "document_id", | |
| 22 | + n_boot: int = 2000, seed: int = 0) -> dict: | |
| 23 | + """Paired difference a - b on identical (document, question, pair) instances; cluster bootstrap CI and two-sided | |
| 24 | + bootstrap p-value (proportion of bootstrap means on the other side of zero, doubled).""" | |
| 25 | + A = df[df[cond_col] == a].set_index(list(keys))[value]; B = df[df[cond_col] == b].set_index(list(keys))[value] | |
| 26 | + j = pd.concat([A.rename("a"), B.rename("b")], axis=1, join="inner").dropna() | |
| 27 | + if j.empty: | |
| 28 | + return {"a": a, "b": b, "diff": np.nan, "lo": np.nan, "hi": np.nan, "p": np.nan, "n": 0, "n_clusters": 0} | |
| 29 | + j["d"] = j["a"] - j["b"]; j = j.reset_index() | |
| 30 | + groups = [g["d"].to_numpy() for _, g in j.groupby(cluster)] | |
| 31 | + rng = np.random.default_rng(seed); G = len(groups) | |
| 32 | + sums = np.array([g.sum() for g in groups]); cnts = np.array([len(g) for g in groups]) | |
| 33 | + boots = np.empty(n_boot) | |
| 34 | + for i in range(n_boot): | |
| 35 | + idx = rng.integers(0, G, G); boots[i] = sums[idx].sum() / cnts[idx].sum() | |
| 36 | + d = float(j["d"].mean()) | |
| 37 | + p = 2 * min((boots <= 0).mean(), (boots >= 0).mean()) if d != 0 else 1.0 | |
| 38 | + return {"a": a, "b": b, "diff": d, "lo": float(np.quantile(boots, 0.025)), "hi": float(np.quantile(boots, 0.975)), "p": float(min(1.0, p)), "n": int(len(j)), "n_clusters": int(G), | |
| 39 | + "mean_a": float(j["a"].mean()), "mean_b": float(j["b"].mean()), "rel_change": float(d / j["b"].mean()) if j["b"].mean() not in (0, np.nan) else np.nan} | |
| 40 | + | |
| 41 | +def holm(pvals: list[float]) -> list[float]: | |
| 42 | + m = len(pvals); order = np.argsort(pvals); adj = np.empty(m) | |
| 43 | + running = 0.0 | |
| 44 | + for rank, i in enumerate(order): | |
| 45 | + v = min(1.0, (m - rank) * pvals[i]); running = max(running, v); adj[i] = running | |
| 46 | + return adj.tolist() | |
| 47 | + | |
| 48 | +def summarize_latency(x: pd.Series) -> dict: | |
| 49 | + x = x.dropna() | |
| 50 | + if x.empty: return {"p50": np.nan, "p95": np.nan, "n": 0} | |
| 51 | + return {"p50": float(x.quantile(0.5)), "p95": float(x.quantile(0.95)), "mean": float(x.mean()), "n": int(len(x))} | |
added
src/wp30/audit.py
+36 −0
@@ -0,0 +1,36 @@ | ||
| 1 | +"""Artifact audit: every raw record validates against the schema; every table/figure has a provenance entry; no secrets in the tree.""" | |
| 2 | +from __future__ import annotations | |
| 3 | +import json, re, glob | |
| 4 | +from pathlib import Path | |
| 5 | +from .util import ROOT, read_jsonl | |
| 6 | +from .records import validate_record | |
| 7 | + | |
| 8 | +SECRET_RE = re.compile(r"(sk-ant-[A-Za-z0-9_-]{20,}|sk-[A-Za-z0-9]{32,}|hf_[A-Za-z0-9]{20,})") | |
| 9 | + | |
| 10 | +def main(root: str) -> int: | |
| 11 | + root = Path(root).resolve(); ok = True | |
| 12 | + n = bad = 0 | |
| 13 | + for p in glob.glob(str(root / "runs/raw/*.jsonl")): | |
| 14 | + if p.endswith("E6_network.jsonl") or "E6_" in p: continue | |
| 15 | + for r in read_jsonl(p): | |
| 16 | + n += 1 | |
| 17 | + if validate_record(r): bad += 1 | |
| 18 | + print(f"records: {n} total, {bad} invalid"); ok &= bad == 0 | |
| 19 | + leaks = [] | |
| 20 | + for p in glob.glob(str(root / "**/*"), recursive=True): | |
| 21 | + pp = Path(p) | |
| 22 | + if pp.is_dir() or ".venv" in p or ".git/" in p or pp.suffix in (".npz", ".safetensors", ".pdf", ".png", ".parquet", ".pyc"): continue | |
| 23 | + try: | |
| 24 | + t = pp.read_text(errors="ignore") | |
| 25 | + except Exception: | |
| 26 | + continue | |
| 27 | + if SECRET_RE.search(t): leaks.append(str(pp.relative_to(root))) | |
| 28 | + print("secret-like strings in tree:", leaks); ok &= not leaks | |
| 29 | + prov = root / "results/provenance.json" | |
| 30 | + if prov.exists(): | |
| 31 | + pv = json.load(open(prov)) | |
| 32 | + missing = [k for k, v in pv.items() if not (root / k).exists()] | |
| 33 | + print(f"provenance entries: {len(pv)}, missing artifacts: {missing}"); ok &= not missing | |
| 34 | + else: | |
| 35 | + print("no results/provenance.json yet") | |
| 36 | + return 0 if ok else 1 | |
added
src/wp30/hosted_run.py
+115 −0
@@ -0,0 +1,115 @@ | ||
| 1 | +"""Track D runner: hosted black-box receivers (Anthropic claude-haiku-4-5; OpenAI gpt-5-nano) on A0-A6 messages built by | |
| 2 | +the LOCAL sender (Qwen2.5-3B), plus provider prefix caching (documented cache_control). Only synthetic + exec + public dev/test | |
| 3 | +items (no private data). Hard budget cap enforced from configs/resources.yaml.""" | |
| 4 | +from __future__ import annotations | |
| 5 | +import json, time, yaml | |
| 6 | +from pathlib import Path | |
| 7 | +import mlx.core as mx | |
| 8 | +from .util import ROOT, read_json, sha256_json, sha256_text, utc_now, read_jsonl | |
| 9 | +from .records import new_record, write_record, trial_key | |
| 10 | +from .data.prepare import load_doc, load_key | |
| 11 | +from .scoring import score_synthetic, score_public | |
| 12 | +from .data.exec_tasks import run_hidden_tests | |
| 13 | +from .prompts import SYSTEM_RECEIVER, SYSTEM_RECEIVER_NOMSG, receiver_user_text, receiver_question_only | |
| 14 | +from .backends.mlx_backend import MLXModel | |
| 15 | +from .methods import text as TM | |
| 16 | +from .hosted import anthropic_answer, openai_answer, Budget | |
| 17 | + | |
| 18 | +def run(config_path: str, resume: bool = False) -> int: | |
| 19 | + cfg = yaml.safe_load(open(config_path)); res = yaml.safe_load(open(ROOT / "configs/resources.yaml")) | |
| 20 | + budget = Budget(res["budgets"]["api"]["hard_cap_usd"], ROOT / "runs/logs/api_cost_ledger.jsonl") | |
| 21 | + mcfg = yaml.safe_load(open(ROOT / "configs/models.yaml"))["models"] | |
| 22 | + sender = MLXModel(mcfg[cfg["sender"]]["repo"]) | |
| 23 | + man = read_json(ROOT / "data/manifests/splits.json") | |
| 24 | + items = [it for it in man["items"] if it["split"] in cfg["splits"] and it["family"] in cfg["families"] and (it.get("target_tokens") is None or it["target_tokens"] in cfg.get("lengths", [it.get("target_tokens")]))] | |
| 25 | + lim = cfg.get("limit_docs_per_family") | |
| 26 | + if lim: | |
| 27 | + items = [it for fam in cfg["families"] for it in [x for x in items if x["family"] == fam][:lim]] | |
| 28 | + out_path = ROOT / "runs/raw" / f"{cfg['experiment_id']}.jsonl"; log_path = ROOT / "runs/logs" / f"{cfg['experiment_id']}.log" | |
| 29 | + done = {r["trial_id"] for r in read_jsonl(out_path) if r["status"] == "success"} if (resume and out_path.exists()) else set() | |
| 30 | + protocol_hash = cfg.get("protocol_hash", "unfrozen"); config_hash = sha256_json(cfg) | |
| 31 | + def log(m): | |
| 32 | + line = f"{utc_now()} {m}"; print(line, flush=True) | |
| 33 | + with open(log_path, "a") as f: f.write(line + "\n") | |
| 34 | + log(f"hosted start {cfg['experiment_id']} items={len(items)} spent_usd={budget.spent:.3f} cap={budget.cap}") | |
| 35 | + for it in items: | |
| 36 | + fam = it["family"]; doc = load_doc(it["document_id"], fam); key = load_key(it["document_id"], fam) | |
| 37 | + qkeys = {q["question_id"]: q for q in key["questions"]} | |
| 38 | + qs = doc["questions"][: cfg.get("max_questions_per_doc") or None] | |
| 39 | + for prov in cfg["providers"]: | |
| 40 | + for cond in cfg["conditions"]: | |
| 41 | + method = cond["method"]; access = cond.get("access", "none"); cid = f"{method}|{prov}|" + "|".join(f"{k}={v}" for k, v in cond.items() if k not in ("method", "access")) | |
| 42 | + pending = [(q, trial_key(cfg["experiment_id"], it["document_id"], q["question_id"], method, {k: v for k, v in cond.items() if k != "method"}, cfg["sender"], prov, access, protocol_hash, 0, "hosted")) for q in qs] | |
| 43 | + pending = [(q, tk) for q, tk in pending if tk not in done] | |
| 44 | + if not pending: continue | |
| 45 | + shared = None | |
| 46 | + if access in ("blind", "none"): | |
| 47 | + shared = _build(method, cond, doc["text"], None, sender) | |
| 48 | + for q, tk in pending: | |
| 49 | + if budget.exhausted(): | |
| 50 | + log("BUDGET EXHAUSTED"); return 0 | |
| 51 | + msg = shared or _build(method, cond, doc["text"], q["question"], sender) | |
| 52 | + material = msg.text; fetched = 0 | |
| 53 | + if method == "A6": | |
| 54 | + material, ri = TM.a6_retrieve(msg, q["question"], cond.get("max_fetch_bytes", 2000), cond.get("max_lookups", 6)); fetched = ri["fetched_bytes"] | |
| 55 | + if method == "A0": | |
| 56 | + system, user = SYSTEM_RECEIVER_NOMSG, receiver_question_only(q["question"], fam) | |
| 57 | + else: | |
| 58 | + system, user = SYSTEM_RECEIVER, receiver_user_text(msg.material_label, material, q["question"], fam) | |
| 59 | + rec = new_record(experiment_id=cfg["experiment_id"], trial_id=tk, run_group_id=f"{cfg['experiment_id']}:{cid}", protocol_hash=protocol_hash, config_hash=config_hash, task_family=fam, | |
| 60 | + document_id=it["document_id"], document_hash=it["document_hash"], question_id=q["question_id"], split=it["split"], cluster_id=it["cluster_id"], | |
| 61 | + sender_model_revision=f"{sender.info.repo_id}@{sender.info.revision}", receiver_model_revision=prov, tokenizer_hashes={"sender": sender.info.tokenizer_hash}, | |
| 62 | + backend_versions={"anthropic_sdk": __import__("anthropic").__version__}, hardware_id="hosted:" + prov.split(":")[0], device_state=None, weight_precision="provider_undisclosed", | |
| 63 | + method_id=method, implementation_fidelity="custom", compression_config={k: v for k, v in cond.items() if k != "method"}, question_access=access, topology="hosted_single_handoff", | |
| 64 | + handoff_index=1 if method != "A0" else 0, reuse_count=len(pending) if access in ("blind", "none") else 1, cache_hit=False, cache_compatibility_hash=None, random_seed=0, | |
| 65 | + source_tokens_sender=len(sender.encode(doc["text"])), source_tokens_receiver=None, query_tokens=None, message_tokens=None, message_utf8_bytes=msg.utf8_bytes, | |
| 66 | + cache_tensor_bytes=None, serialized_payload_bytes=msg.payload_bytes, side_information_bytes=0, fetched_bytes=fetched, timing_spans={"encode_ms": msg.encode_ms}, | |
| 67 | + input_usage={**msg.sender_usage}, output_usage={}, provider_cached_usage=None, process_memory=None, backend_memory=None, peak_prefill_memory=None, peak_decode_memory=None, | |
| 68 | + mapper_memory=None, cost_with_source=None, prediction_artifact=None, evidence_artifact=None, reference_key_id=f"keys/{fam}/{it['document_id']}.json", task_scores=None, | |
| 69 | + status="implementation_error", error_code=None, log_artifact=str(log_path.relative_to(ROOT)), payload_hash=sha256_text(material), output_hash=None) | |
| 70 | + try: | |
| 71 | + max_out = 320 if fam == "exec" else 64 | |
| 72 | + if prov.startswith("anthropic"): | |
| 73 | + use_cache = cond.get("provider_cache", False) | |
| 74 | + blocks = [{"text": user}] | |
| 75 | + if use_cache and method != "A0": | |
| 76 | + # split material (cacheable) from question (fresh) so the provider can cache the document prefix | |
| 77 | + blocks = [{"text": f"{msg.material_label}:\n{material}\n\n", "cache": True}, {"text": user.split(material, 1)[-1].lstrip("\n")}] | |
| 78 | + r = anthropic_answer(system, blocks, model=res["budgets"]["api"]["providers"]["anthropic"]["model"], max_tokens=max_out, use_cache_control=use_cache) | |
| 79 | + rec["provider_cached_usage"] = {"cache_creation_input_tokens": r["cache_creation_input_tokens"], "cache_read_input_tokens": r["cache_read_input_tokens"]} | |
| 80 | + else: | |
| 81 | + r = openai_answer(system, user, model=res["budgets"]["api"]["providers"]["openai"]["model"], max_tokens=max_out) | |
| 82 | + rec["provider_cached_usage"] = {"cached_tokens": r["cached_tokens"]} | |
| 83 | + budget.charge(r["cost_usd_estimated"], {"experiment": cfg["experiment_id"], "trial": tk, "provider": prov, "model": r["model"]}) | |
| 84 | + pred = r["text"] | |
| 85 | + rec.update({"prediction_artifact": pred, "output_hash": sha256_text(pred), "ttft_ms": r["ttft_ms"], "total_wall_ms": r["total_ms"] + msg.encode_ms, | |
| 86 | + "input_usage": {**rec["input_usage"], "provider_input_tokens": r["input_tokens"]}, "output_usage": {"provider_output_tokens": r["output_tokens"]}, | |
| 87 | + "cost_with_source": {"usd": r["cost_usd_estimated"], "kind": "estimated", "price_source": r["price_source"], "model": r["model"]}, "receiver_model_revision": r["model"]}) | |
| 88 | + rec["timing_spans"].update({"provider_total_ms": r["total_ms"], "ttft_ms": r["ttft_ms"]}) | |
| 89 | + qk = qkeys[q["question_id"]] | |
| 90 | + if fam == "exec": | |
| 91 | + t = run_hidden_tests(pred, key["hidden_tests"]); rec["task_scores"] = {"correct": t["correct"], "pass_rate": t["pass_rate"], "error": t.get("error")} | |
| 92 | + elif fam.startswith("public_"): | |
| 93 | + rec["task_scores"] = score_public(pred, [qk["answer"]] + list(qk.get("aliases", []))) | |
| 94 | + else: | |
| 95 | + rec["task_scores"] = score_synthetic(pred, qk) | |
| 96 | + rec["status"] = "success" if pred.strip() else "invalid_output" | |
| 97 | + except Exception as e: | |
| 98 | + rec["error_code"] = f"{type(e).__name__}: {str(e)[:300]}" | |
| 99 | + if "rate" in str(e).lower(): time.sleep(5) | |
| 100 | + write_record(rec, out_path) | |
| 101 | + sc = rec["task_scores"] or {} | |
| 102 | + log(f"{cid:>36s} {it['document_id']:>26s} {q['question_id']:>16s} {rec['status']:>8s} corr={sc.get('correct', sc.get('f1'))} cost={(rec['cost_with_source'] or {}).get('usd', 0):.5f} cached={rec['provider_cached_usage']} ans={json.dumps((rec['prediction_artifact'] or '')[:40])}") | |
| 103 | + mx.clear_cache() | |
| 104 | + log(f"hosted end spent_usd={budget.spent:.3f}") | |
| 105 | + return 0 | |
| 106 | + | |
| 107 | +def _build(method, cond, doc_text, question, sender): | |
| 108 | + if method == "A0": return TM.a0_no_message() | |
| 109 | + if method == "A1": return TM.a1_full(doc_text) | |
| 110 | + if method == "A2": return TM.a2_truncate(doc_text, cond["budget_tokens"], sender.tokenizer) | |
| 111 | + if method == "A3": return TM.a3_extractive(doc_text, cond["budget_tokens"], sender.tokenizer, question) | |
| 112 | + if method == "A4": return TM.a4_summary(doc_text, cond["budget_tokens"], sender, question) | |
| 113 | + if method == "A5": return TM.a5_structured(doc_text, cond["budget_tokens"], sender, question) | |
| 114 | + if method == "A6": return TM.a6_references(doc_text, cond["budget_tokens"], sender, question) | |
| 115 | + raise NotImplementedError(method) | |
added
src/wp30/literature.py
+52 −0
@@ -0,0 +1,52 @@ | ||
| 1 | +"""Build paper/references.bib from the verified sources CSV + curated core entries (fields only from the audit files).""" | |
| 2 | +from __future__ import annotations | |
| 3 | +import csv, re, yaml | |
| 4 | +from pathlib import Path | |
| 5 | +from .util import ROOT | |
| 6 | + | |
| 7 | +CORE_BIB = r""" | |
| 8 | +@misc{alabdulkareem2026swat, title={SwaT: Cross-Family KV Cache Transfer between Language Models}, author={Alabdulkareem, Abdulrahman and Tenison, Isabel and Zhang, Jun and Zhu, Yiyang and Katz, Boris and Gutfreund, Dan}, year={2026}, eprint={2610.15095}, archivePrefix={arXiv}, note={arXiv preprint, v1 (October 2026); repository Ar-Kareem/SwaT, no released checkpoint or licence (verified 2026-10-29)}} | |
| 9 | +@misc{zweiger2026compaction, title={Fast KV Compaction via Attention Matching}, author={Zweiger, Adam and Fu, Yilun and Guo, Han and Kim, Yoon}, year={2026}, eprint={2602.16284}, archivePrefix={arXiv}, note={arXiv preprint, v2 (May 2026); code adamzweiger/compaction, MIT}} | |
| 10 | +@inproceedings{fu2026c2c, title={Cache-to-Cache: Direct Semantic Communication Between Large Language Models}, author={Fu, Tianyu and others}, booktitle={International Conference on Learning Representations (ICLR)}, year={2026}, note={arXiv:2510.03215; code thu-nics/C2C, Apache-2.0; fuser checkpoints nics-efc/C2C\_Fuser}} | |
| 11 | +@inproceedings{zou2026latentmas, title={LatentMAS: Latent Collaboration in Multi-Agent Systems}, author={Zou, Jiaru and others}, booktitle={International Conference on Machine Learning (ICML)}, year={2026}, note={arXiv:2511.20639; code Gen-Verse/LatentMAS, Apache-2.0}} | |
| 12 | +@inproceedings{liu2024kivi, title={KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache}, author={Liu, Zirui and Yuan, Jiayi and Jin, Hongye and Zhong, Shaochen and Xu, Zhaozhuo and Braverman, Vladimir and Chen, Beidi and Hu, Xia}, booktitle={International Conference on Machine Learning (ICML)}, year={2024}, note={arXiv:2402.02750}} | |
| 13 | +@inproceedings{li2024snapkv, title={SnapKV: LLM Knows What You are Looking for Before Generation}, author={Li, Yuhong and Huang, Yingbing and Yang, Bowen and Venkitesh, Bharat and Locatelli, Acyr and Ye, Hanchen and Cai, Tianle and Lewis, Patrick and Chen, Deming}, booktitle={Advances in Neural Information Processing Systems (NeurIPS)}, year={2024}, note={arXiv:2404.14469; code FasterDecoding/SnapKV}} | |
| 14 | +@misc{cai2024pyramidkv, title={PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling}, author={Cai, Zefan and Zhang, Yichi and Gao, Bofei and Liu, Yuliang and Li, Yucheng and Liu, Tianyu and Lu, Keming and Xiong, Wayne and Dong, Yue and Hu, Junjie and Xiao, Wen}, year={2024}, eprint={2406.02069}, archivePrefix={arXiv}, note={v4 (May 2025); code Zefan-Cai/KVCache-Factory, MIT}} | |
| 15 | +@inproceedings{zhang2023h2o, title={H$_2$O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models}, author={Zhang, Zhenyu and Sheng, Ying and Zhou, Tianyi and Chen, Tianlong and Zheng, Lianmin and Cai, Ruisi and Song, Zhao and Tian, Yuandong and R{\'e}, Christopher and Barrett, Clark and Wang, Zhangyang and Chen, Beidi}, booktitle={Advances in Neural Information Processing Systems (NeurIPS)}, year={2023}, note={arXiv:2306.14048}} | |
| 16 | +@inproceedings{xiao2024streamingllm, title={Efficient Streaming Language Models with Attention Sinks}, author={Xiao, Guangxuan and Tian, Yuandong and Chen, Beidi and Han, Song and Lewis, Mike}, booktitle={International Conference on Learning Representations (ICLR)}, year={2024}, note={arXiv:2309.17453}} | |
| 17 | +@inproceedings{pan2024llmlingua2, title={LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression}, author={Pan, Zhuoshi and Wu, Qianhui and Jiang, Huiqiang and Xia, Menglin and Luo, Xufang and Zhang, Jue and Lin, Qingwei and R{\"u}hle, Victor and Yang, Yuqing and Lin, Chin-Yew and Zhao, H. Vicky and Qiu, Lili and Zhang, Dongmei}, booktitle={Findings of the Association for Computational Linguistics: ACL 2024}, year={2024}, note={arXiv:2403.12968}} | |
| 18 | +@inproceedings{bai2024longbench, title={LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding}, author={Bai, Yushi and Lv, Xin and Zhang, Jiajie and Lyu, Hongchang and Tang, Jiankai and Huang, Zhidian and Du, Zhengxiao and Liu, Xiao and Zeng, Aohan and Hou, Lei and Dong, Yuxiao and Tang, Jie and Li, Juanzi}, booktitle={Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)}, pages={3119--3137}, year={2024}, doi={10.18653/v1/2024.acl-long.172}} | |
| 19 | +@inproceedings{hsieh2024ruler, title={RULER: What's the Real Context Size of Your Long-Context Language Models?}, author={Hsieh, Cheng-Ping and Sun, Simeng and Kriman, Samuel and Acharya, Shantanu and Rekesh, Dima and Jia, Fei and Zhang, Yang and Ginsburg, Boris}, booktitle={First Conference on Language Modeling (COLM)}, year={2024}, note={arXiv:2404.06654}} | |
| 20 | +@misc{mlxlm2026, title={mlx-lm: Run LLMs with MLX}, author={{Apple ML Explore contributors}}, year={2026}, howpublished={\url{https://github.com/ml-explore/mlx-lm}}, note={v0.32.2 (16 October 2026), MIT}} | |
| 21 | +@misc{anthropic2026caching, title={Prompt caching}, author={{Anthropic}}, year={2026}, howpublished={\url{https://platform.claude.com/docs/en/build-with-claude/prompt-caching}}, note={accessed 2026-10-29}} | |
| 22 | +@misc{hf2026kvcache, title={KV cache strategies}, author={{Hugging Face}}, year={2026}, howpublished={\url{https://huggingface.co/docs/transformers/en/kv_cache}}, note={Transformers v5 documentation, accessed 2026-10-29}} | |
| 23 | +@misc{dasigi2021qasper, title={A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers}, author={Dasigi, Pradeep and Lo, Kyle and Beltagy, Iz and Cohan, Arman and Smith, Noah A. and Gardner, Matt}, year={2021}, note={NAACL 2021; QASPER, CC BY 4.0}} | |
| 24 | +@inproceedings{ho2020twowiki, title={Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Steps}, author={Ho, Xanh and Nguyen, Anh-Khoa Duong and Sugawara, Saku and Aizawa, Akiko}, booktitle={Proceedings of the 28th International Conference on Computational Linguistics (COLING)}, year={2020}} | |
| 25 | +@inproceedings{yang2018hotpotqa, title={HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering}, author={Yang, Zhilin and Qi, Peng and Zhang, Saizheng and Bengio, Yoshua and Cohen, William W. and Salakhutdinov, Ruslan and Manning, Christopher D.}, booktitle={EMNLP}, year={2018}} | |
| 26 | +@misc{qwen2.5, title={Qwen2.5 Technical Report}, author={{Qwen Team}}, year={2024}, eprint={2412.15115}, archivePrefix={arXiv}} | |
| 27 | +@misc{llama3, title={The Llama 3 Herd of Models}, author={{Llama Team, AI @ Meta}}, year={2024}, eprint={2407.21783}, archivePrefix={arXiv}} | |
| 28 | +""" | |
| 29 | + | |
| 30 | +def _bibkey(row): | |
| 31 | + first = re.split(r"[,; ]+", row["authors"].strip())[0].lower() if row["authors"] and row["authors"] != "unverified" else row["source_id"] | |
| 32 | + first = re.sub(r"[^a-z]", "", first) or row["source_id"] | |
| 33 | + return f"{first}{row['year']}_{row['source_id']}" | |
| 34 | + | |
| 35 | +def audit(config_path: str) -> int: | |
| 36 | + cfg = yaml.safe_load(open(config_path)) | |
| 37 | + rows = list(csv.DictReader(open(ROOT / cfg["sources_csv"], newline=""))) | |
| 38 | + core_ids = {"swat2026", "compaction2026", "c2c2025", "latentmas2025", "kivi2024", "snapkv2024", "pyramidkv2024", "h2o2023", "streamingllm2023", "llmlingua2_2024", "longbench2024", "ruler2024", "mlxlm2026", "hf_kvcache_docs", "anthropic_prompt_caching"} | |
| 39 | + extra = [] | |
| 40 | + for r in rows: | |
| 41 | + if r["source_id"] in core_ids or r["verification"].startswith("unverified"): | |
| 42 | + continue | |
| 43 | + m = re.search(r"(\d{4}\.\d{5})", r["url"] or "") | |
| 44 | + if not m: continue | |
| 45 | + title = r["title"].replace("{", "").replace("}", "") | |
| 46 | + extra.append(f"@misc{{{_bibkey(r)}, title={{{title}}}, author={{{r['authors'] if r['authors'] != 'unverified' else 'unverified'}}}, year={{{r['year']}}}, eprint={{{m.group(1)}}}, archivePrefix={{arXiv}}, note={{{r['venue_status']}; verification: {r['verification'][:80]}}}}}") | |
| 47 | + out = "% Generated by `python -m wp30 sources audit` from literature/sources.csv (verified 2026-10-29) + curated core entries.\n" + CORE_BIB + "\n" + "\n".join(extra) + "\n" | |
| 48 | + (ROOT / cfg["bib_out"]).parent.mkdir(parents=True, exist_ok=True) | |
| 49 | + (ROOT / cfg["bib_out"]).write_text(out) | |
| 50 | + n_ver = sum(1 for r in rows if not r["verification"].startswith("unverified")) | |
| 51 | + print(f"sources: {len(rows)} rows, {n_ver} verified; bib entries: {out.count('@')}") | |
| 52 | + return 0 | |
added
src/wp30/mapper.py
+152 −0
@@ -0,0 +1,152 @@ | ||
| 1 | +"""Track C: learned cross-checkpoint KV mapping (level 2: same family / different size, shared tokenizer). | |
| 2 | + | |
| 3 | +Sender Qwen2.5-1.5B (28 layers, 2 KV heads x 128) -> receiver Qwen2.5-3B (36 layers, 2 KV heads x 128). Both use RoPE with | |
| 4 | +identical theta/head_dim, and mlx_lm stores keys post-RoPE; we un-rotate keys with their known positions, fit per-receiver-layer | |
| 5 | +linear maps [K_s(l_s), V_s(l_s)] (512) -> K_r (256) and V_r (256) by ridge regression on TRAIN-split caches only | |
| 6 | +(closed form; sufficient statistics accumulated in float64), then re-rotate mapped keys. l_s = round(l_r * (L_s-1)/(L_r-1)). | |
| 7 | + | |
| 8 | +This is a custom linear mapper fitted with a reconstruction loss only (lambda_task = lambda_distill = 0). It is NOT SwaT | |
| 9 | +(no SwaT checkpoint or licence exists; SwaT trains a ~300M mapper with generation/distillation terms). | |
| 10 | +""" | |
| 11 | +from __future__ import annotations | |
| 12 | +import json, time, yaml | |
| 13 | +from pathlib import Path | |
| 14 | +import numpy as np | |
| 15 | +import mlx.core as mx | |
| 16 | +from .util import ROOT, read_json, write_json, utc_now, sha256_file, sha256_json | |
| 17 | +from .backends.mlx_backend import MLXModel | |
| 18 | +from .cache.sparse import SparseKVCache, dense_kv | |
| 19 | +from .data.prepare import load_doc | |
| 20 | +from .prompts import SYSTEM_RECEIVER | |
| 21 | + | |
| 22 | +def _rope_angles(T: int, d: int, theta: float, offset: int = 0) -> np.ndarray: | |
| 23 | + pos = np.arange(offset, offset + T, dtype=np.float64) | |
| 24 | + inv = theta ** (-np.arange(0, d, 2, dtype=np.float64) / d) # d/2 freqs | |
| 25 | + return pos[:, None] * inv[None, :] # [T, d/2] | |
| 26 | + | |
| 27 | +def unrotate(k: np.ndarray, theta: float, offset: int = 0) -> np.ndarray: | |
| 28 | + """k: [H, T, d] post-RoPE (non-traditional 'rotate-half' layout as in mlx_lm/HF Qwen2). Returns pre-RoPE keys.""" | |
| 29 | + H, T, d = k.shape | |
| 30 | + ang = _rope_angles(T, d, theta, offset); c, s = np.cos(ang), np.sin(ang) # [T, d/2] | |
| 31 | + x1, x2 = k[..., : d // 2], k[..., d // 2:] | |
| 32 | + # forward: y1 = x1 c - x2 s ; y2 = x1 s + x2 c -> inverse: x1 = y1 c + y2 s ; x2 = -y1 s + y2 c | |
| 33 | + return np.concatenate([x1 * c + x2 * s, -x1 * s + x2 * c], axis=-1) | |
| 34 | + | |
| 35 | +def rotate(k: np.ndarray, theta: float, offset: int = 0) -> np.ndarray: | |
| 36 | + H, T, d = k.shape | |
| 37 | + ang = _rope_angles(T, d, theta, offset); c, s = np.cos(ang), np.sin(ang) | |
| 38 | + x1, x2 = k[..., : d // 2], k[..., d // 2:] | |
| 39 | + return np.concatenate([x1 * c - x2 * s, x1 * s + x2 * c], axis=-1) | |
| 40 | + | |
| 41 | +def verify_rope_inverse(model: MLXModel) -> float: | |
| 42 | + """Check that unrotate(rotate(x)) == x and that unrotate matches the model's own rope (layer 0) on a random input.""" | |
| 43 | + d = model.info.head_dim; theta = model.info.rope_theta | |
| 44 | + x = np.random.default_rng(0).standard_normal((2, 17, d)).astype(np.float32) | |
| 45 | + err1 = float(np.abs(unrotate(rotate(x, theta, 5), theta, 5) - x).max()) | |
| 46 | + rope = model.model.model.layers[0].self_attn.rope | |
| 47 | + y = np.array(rope(mx.array(x)[None], offset=5)[0].astype(mx.float32)) | |
| 48 | + err2 = float(np.abs(rotate(x, theta, 5) - y).max()) | |
| 49 | + return max(err1, err2) | |
| 50 | + | |
| 51 | +class LinearKVMapper: | |
| 52 | + def __init__(self, sender_info, receiver_info, layer_map: list[int], ridge: float): | |
| 53 | + self.s, self.r = sender_info, receiver_info | |
| 54 | + self.layer_map = layer_map; self.ridge = ridge | |
| 55 | + ds = sender_info.num_kv_heads * sender_info.head_dim; dr = receiver_info.num_kv_heads * receiver_info.head_dim | |
| 56 | + self.din = 2 * ds + 1; self.dout = 2 * dr | |
| 57 | + self.W = [None] * receiver_info.num_layers # [din, dout] (K and V stacked) | |
| 58 | + # sufficient statistics | |
| 59 | + self._xtx = [np.zeros((self.din, self.din)) for _ in range(receiver_info.num_layers)] | |
| 60 | + self._xty = [np.zeros((self.din, self.dout)) for _ in range(receiver_info.num_layers)] | |
| 61 | + self.n_tokens = 0 | |
| 62 | + | |
| 63 | + def _features(self, s_cache, lr: int) -> np.ndarray: | |
| 64 | + ls = self.layer_map[lr] | |
| 65 | + k, v = dense_kv(s_cache[ls]); k = np.array(k[0].astype(mx.float32)); v = np.array(v[0].astype(mx.float32)) # [H, T, d] | |
| 66 | + k = unrotate(k, self.s.rope_theta, 0) | |
| 67 | + H, T, d = k.shape | |
| 68 | + X = np.concatenate([k.transpose(1, 0, 2).reshape(T, -1), v.transpose(1, 0, 2).reshape(T, -1), np.ones((T, 1))], axis=1) | |
| 69 | + return X | |
| 70 | + | |
| 71 | + def accumulate(self, s_cache, r_cache): | |
| 72 | + for lr in range(self.r.num_layers): | |
| 73 | + X = self._features(s_cache, lr) | |
| 74 | + k, v = dense_kv(r_cache[lr]); k = np.array(k[0].astype(mx.float32)); v = np.array(v[0].astype(mx.float32)) | |
| 75 | + k = unrotate(k, self.r.rope_theta, 0); T = k.shape[1] | |
| 76 | + Y = np.concatenate([k.transpose(1, 0, 2).reshape(T, -1), v.transpose(1, 0, 2).reshape(T, -1)], axis=1) | |
| 77 | + self._xtx[lr] += X.T @ X; self._xty[lr] += X.T @ Y | |
| 78 | + self.n_tokens += X.shape[0] | |
| 79 | + | |
| 80 | + def solve(self): | |
| 81 | + for lr in range(self.r.num_layers): | |
| 82 | + A = self._xtx[lr] + self.ridge * np.eye(self.din); A[-1, -1] -= self.ridge # do not penalize bias | |
| 83 | + self.W[lr] = np.linalg.solve(A, self._xty[lr]).astype(np.float32) | |
| 84 | + | |
| 85 | + def apply(self, s_cache, receiver_dtype=mx.bfloat16) -> list: | |
| 86 | + """Map a sender cache (dense, positions 0..T-1) into a receiver SparseKVCache list (all positions, logical offset T).""" | |
| 87 | + out = [] | |
| 88 | + for lr in range(self.r.num_layers): | |
| 89 | + X = self._features(s_cache, lr) | |
| 90 | + Y = X @ self.W[lr] | |
| 91 | + T = X.shape[0]; H, d = self.r.num_kv_heads, self.r.head_dim | |
| 92 | + k = Y[:, : H * d].reshape(T, H, d).transpose(1, 0, 2); v = Y[:, H * d:].reshape(T, H, d).transpose(1, 0, 2) | |
| 93 | + k = rotate(k, self.r.rope_theta, 0) | |
| 94 | + c = SparseKVCache.from_dense(mx.array(k[None].astype(np.float32)).astype(receiver_dtype), mx.array(v[None].astype(np.float32)).astype(receiver_dtype), logical_offset=T) | |
| 95 | + out.append(c) | |
| 96 | + return out | |
| 97 | + | |
| 98 | + def save(self, path: Path, meta: dict): | |
| 99 | + np.savez_compressed(path, **{f"W{l}": w for l, w in enumerate(self.W)}, layer_map=np.array(self.layer_map)) | |
| 100 | + write_json(str(path) + ".manifest.json", {**meta, "sender": self.s.repo_id, "sender_revision": self.s.revision, "receiver": self.r.repo_id, "receiver_revision": self.r.revision, | |
| 101 | + "layer_map": self.layer_map, "ridge": self.ridge, "n_train_tokens": self.n_tokens, "params": int(sum(w.size for w in self.W)), | |
| 102 | + "checkpoint_sha256": sha256_file(path), "created_utc": utc_now(), "loss": "ridge least squares on un-rotated K and V (reconstruction only)"}) | |
| 103 | + | |
| 104 | + @classmethod | |
| 105 | + def load(cls, path: Path, sender_info, receiver_info): | |
| 106 | + z = np.load(path); lm = z["layer_map"].tolist() | |
| 107 | + m = cls(sender_info, receiver_info, lm, 0.0); m.W = [z[f"W{l}"] for l in range(receiver_info.num_layers)] | |
| 108 | + return m | |
| 109 | + | |
| 110 | +def identity_transfer_negative_control(s_cache, receiver_info, layer_map) -> list: | |
| 111 | + """Feed sender K/V directly as receiver cache (shapes match: 2 heads x 128) — incompatible state, diagnostic only.""" | |
| 112 | + out = [] | |
| 113 | + for lr in range(receiver_info.num_layers): | |
| 114 | + k, v = dense_kv(s_cache[layer_map[lr]]) | |
| 115 | + out.append(SparseKVCache.from_dense(mx.array(k), mx.array(v), logical_offset=int(k.shape[2]))) | |
| 116 | + return out | |
| 117 | + | |
| 118 | +def train_main(config_path: str) -> int: | |
| 119 | + cfg = yaml.safe_load(open(config_path)); mcfg = yaml.safe_load(open(ROOT / "configs/models.yaml"))["models"] | |
| 120 | + sender = MLXModel(mcfg[cfg["sender"]]["repo"]); receiver = MLXModel(mcfg[cfg["receiver"]]["repo"]) | |
| 121 | + assert sender.info.tokenizer_hash == receiver.info.tokenizer_hash, "level-2 mapper requires a shared tokenizer" | |
| 122 | + Ls, Lr = sender.info.num_layers, receiver.info.num_layers | |
| 123 | + layer_map = [int(round(lr * (Ls - 1) / (Lr - 1))) for lr in range(Lr)] | |
| 124 | + err = verify_rope_inverse(receiver); print("rope inverse max err", err); assert err < 1e-3 | |
| 125 | + man = read_json(ROOT / "data/manifests/splits.json") | |
| 126 | + items = [it for it in man["items"] if it["split"] == "train" and it["family"] in cfg["families"]] | |
| 127 | + mp = LinearKVMapper(sender.info, receiver.info, layer_map, cfg.get("ridge", 1.0)) | |
| 128 | + t0 = time.time(); log = [] | |
| 129 | + for i, it in enumerate(items): | |
| 130 | + doc = load_doc(it["document_id"], it["family"]) | |
| 131 | + ids = receiver.chat_prompt_tokens([{"role": "system", "content": SYSTEM_RECEIVER}, {"role": "user", "content": "Document:\n" + doc["text"] + "\n\n"}]) | |
| 132 | + ids = ids[: cfg.get("max_tokens_per_doc", 8192)] | |
| 133 | + sc, _ = sender.prefill(ids); rc, _ = receiver.prefill(ids) | |
| 134 | + mp.accumulate(sc, rc) | |
| 135 | + del sc, rc; mx.clear_cache() | |
| 136 | + log.append({"doc": it["document_id"], "tokens": len(ids), "elapsed_s": time.time() - t0}); print(i, it["document_id"], len(ids), "tokens; cumulative", mp.n_tokens, flush=True) | |
| 137 | + mp.solve() | |
| 138 | + # held-out reconstruction error on dev docs | |
| 139 | + dev = [it for it in man["items"] if it["split"] == "dev" and it["family"] in cfg["families"]][: cfg.get("n_dev_eval", 4)] | |
| 140 | + rel = [] | |
| 141 | + for it in dev: | |
| 142 | + doc = load_doc(it["document_id"], it["family"]) | |
| 143 | + ids = receiver.chat_prompt_tokens([{"role": "system", "content": SYSTEM_RECEIVER}, {"role": "user", "content": "Document:\n" + doc["text"] + "\n\n"}])[: cfg.get("max_tokens_per_doc", 8192)] | |
| 144 | + sc, _ = sender.prefill(ids); rc, _ = receiver.prefill(ids); mapped = mp.apply(sc) | |
| 145 | + for lr in [0, Lr // 2, Lr - 1]: | |
| 146 | + k_true, v_true = dense_kv(rc[lr]); k_m, v_m = mapped[lr].keys_and_values() | |
| 147 | + kt = np.array(k_true.astype(mx.float32)); km = np.array(k_m.astype(mx.float32)); vt = np.array(v_true.astype(mx.float32)); vm = np.array(v_m.astype(mx.float32)) | |
| 148 | + rel.append({"doc": it["document_id"], "layer": lr, "rel_err_k": float(np.linalg.norm(kt - km) / np.linalg.norm(kt)), "rel_err_v": float(np.linalg.norm(vt - vm) / np.linalg.norm(vt))}) | |
| 149 | + out = ROOT / "runs/checkpoints" / f"mapper_{cfg['sender']}_to_{cfg['receiver']}.npz"; out.parent.mkdir(parents=True, exist_ok=True) | |
| 150 | + mp.save(out, {"config": cfg, "train_docs": [l["doc"] for l in log], "train_seconds": time.time() - t0, "dev_reconstruction": rel, "device": "laptop-m5max"}) | |
| 151 | + print(json.dumps({"n_train_tokens": mp.n_tokens, "params": int(sum(w.size for w in mp.W)), "train_seconds": round(time.time() - t0), "dev_rel_err": rel[:6]}, indent=1)) | |
| 152 | + return 0 | |
added
src/wp30/protocol.py
+26 −0
@@ -0,0 +1,26 @@ | ||
| 1 | +"""Protocol freeze: hash the confirmatory configuration (models, prompts, datasets, budgets, scorers, hypotheses, stats plan).""" | |
| 2 | +from __future__ import annotations | |
| 3 | +import json, yaml, hashlib, datetime as dt | |
| 4 | +from pathlib import Path | |
| 5 | +from .util import ROOT, sha256_file, sha256_text, write_json, utc_now | |
| 6 | + | |
| 7 | +FROZEN_FILES = ["configs/models.yaml", "configs/data.yaml", "configs/resources.yaml", "src/wp30/prompts.py", "src/wp30/scoring.py", "src/wp30/data/synthetic.py", | |
| 8 | + "src/wp30/data/exec_tasks.py", "src/wp30/methods/text.py", "src/wp30/cache/sparse.py", "src/wp30/cache/selection.py", "src/wp30/cache/serialize.py", | |
| 9 | + "src/wp30/backends/mlx_backend.py", "src/wp30/runner.py", "src/wp30/chains.py", "src/wp30/fanin.py", "protocol/hypotheses.md", "protocol/analysis_plan.md", | |
| 10 | + "data/manifests/splits.json"] | |
| 11 | + | |
| 12 | +def freeze(core_config: str) -> int: | |
| 13 | + cfg = yaml.safe_load(open(core_config)) | |
| 14 | + files = {f: sha256_file(ROOT / f) for f in FROZEN_FILES if (ROOT / f).exists()} | |
| 15 | + extra = {f: sha256_file(ROOT / f) for f in cfg.get("frozen_extra_files", []) if (ROOT / f).exists()} | |
| 16 | + body = {"frozen_utc": utc_now(), "core_config": core_config, "core_config_sha256": sha256_file(ROOT / core_config), "files": {**files, **extra}, | |
| 17 | + "test_split_first_evaluation": "after this freeze; see runs/logs/*core*.log first timestamp", "hypotheses": (ROOT / "protocol/hypotheses.md").read_text()[:4000]} | |
| 18 | + h = sha256_text(json.dumps(body["files"], sort_keys=True) + body["core_config_sha256"]) | |
| 19 | + body["protocol_hash"] = h | |
| 20 | + write_json(ROOT / "protocol/frozen.json", body) | |
| 21 | + print("protocol frozen:", h) | |
| 22 | + return 0 | |
| 23 | + | |
| 24 | +def current_hash() -> str | None: | |
| 25 | + p = ROOT / "protocol/frozen.json" | |
| 26 | + return json.load(open(p))["protocol_hash"] if p.exists() else None | |
added
src/wp30/reproduce.py
+35 −0
@@ -0,0 +1,35 @@ | ||
| 1 | +"""Minimal reproduction profile: rerun a fixed small subset from a clean process and compare deterministic outputs | |
| 2 | +(greedy decoding) with the original records; rebuild analysis tables from raw records without inference.""" | |
| 3 | +from __future__ import annotations | |
| 4 | +import json, yaml, subprocess, sys, shutil, time | |
| 5 | +from pathlib import Path | |
| 6 | +from .util import ROOT, read_jsonl, write_json, utc_now | |
| 7 | + | |
| 8 | +def main(profile: str) -> int: | |
| 9 | + prof = yaml.safe_load(open(profile)) | |
| 10 | + report = {"started_utc": utc_now(), "profile": prof, "steps": []} | |
| 11 | + # 1. inference reproduction: run the profile config into a fresh experiment id, then compare predictions by trial key | |
| 12 | + cfg_path = ROOT / prof["config"]; cfg = yaml.safe_load(open(cfg_path)) | |
| 13 | + orig = {r["trial_id"]: r for r in read_jsonl(ROOT / "runs/raw" / f"{cfg['experiment_id']}.jsonl")} if (ROOT / "runs/raw" / f"{cfg['experiment_id']}.jsonl").exists() else {} | |
| 14 | + tmp_cfg = dict(cfg); tmp_cfg["experiment_id"] = cfg["experiment_id"] + "_repro" | |
| 15 | + # keep trial keys identical: trial_key uses experiment_id -> compute keys with original id by passing an override | |
| 16 | + tmp_cfg["trial_key_experiment_id"] = cfg["experiment_id"] | |
| 17 | + tmp_path = ROOT / "reproduction" / "_repro_config.yaml"; yaml.safe_dump(tmp_cfg, open(tmp_path, "w")) | |
| 18 | + out = ROOT / "runs/raw" / f"{tmp_cfg['experiment_id']}.jsonl" | |
| 19 | + if out.exists(): out.unlink() | |
| 20 | + t0 = time.time() | |
| 21 | + rc = subprocess.call([sys.executable, "-m", "wp30", "run", "--config", str(tmp_path)], cwd=ROOT) | |
| 22 | + rep = {r["trial_id"]: r for r in read_jsonl(out)} | |
| 23 | + matched = sum(1 for k, r in rep.items() if k in orig and orig[k]["output_hash"] == r["output_hash"]) | |
| 24 | + compared = sum(1 for k in rep if k in orig) | |
| 25 | + score_match = sum(1 for k, r in rep.items() if k in orig and json.dumps(orig[k]["task_scores"], sort_keys=True) == json.dumps(r["task_scores"], sort_keys=True)) | |
| 26 | + report["steps"].append({"step": "inference_rerun", "exit_code": rc, "seconds": time.time() - t0, "reran": len(rep), "compared_with_original": compared, | |
| 27 | + "identical_output_hash": matched, "identical_task_scores": score_match}) | |
| 28 | + # 2. analysis-only reproduction | |
| 29 | + t0 = time.time() | |
| 30 | + rc2 = subprocess.call([sys.executable, "-m", "wp30", "analyze", "--protocol", "protocol/frozen.json"], cwd=ROOT) | |
| 31 | + report["steps"].append({"step": "analysis_rebuild", "exit_code": rc2, "seconds": time.time() - t0}) | |
| 32 | + report["finished_utc"] = utc_now() | |
| 33 | + write_json(ROOT / "reproduction/report.json", report) | |
| 34 | + print(json.dumps(report["steps"], indent=1)) | |
| 35 | + return 0 if rc == 0 and rc2 == 0 else 1 | |
added
src/wp30/router.py
+58 −0
@@ -0,0 +1,58 @@ | ||
| 1 | +"""E8: adaptive representation policy fitted on development records only. | |
| 2 | + | |
| 3 | +Features (deployment-observable): context tokens (receiver tokenizer), question-access regime, task family, receiver model, | |
| 4 | +reuse count N, measured LAN bandwidth (constant from E6), and the candidate action's development cost model. | |
| 5 | +Action = condition id among a feasible set. Quality constraint = lower 95% bootstrap bound of dev mean quality for the (family, | |
| 6 | +context-bin, pair) group >= tau * best static lower bound; cost = dev mean amortized latency (or bytes). Policy = argmin cost subject | |
| 7 | +to constraint, with fallback to the dev-best static action if no action satisfies the constraint. Frozen before test evaluation. | |
| 8 | +""" | |
| 9 | +from __future__ import annotations | |
| 10 | +import json, yaml | |
| 11 | +import numpy as np, pandas as pd | |
| 12 | +from pathlib import Path | |
| 13 | +from .util import ROOT, write_json, read_json | |
| 14 | +from .analysis.load import load_experiments | |
| 15 | +from .analysis.stats import cluster_bootstrap_mean | |
| 16 | + | |
| 17 | +def _ctx_bin(tokens): | |
| 18 | + return "short" if tokens <= 3000 else ("medium" if tokens <= 10000 else "long") | |
| 19 | + | |
| 20 | +def fit(dev_df: pd.DataFrame, actions: list[str], cost_col: str, tau: float, n_boot: int = 500) -> dict: | |
| 21 | + policy = {"actions": actions, "cost_col": cost_col, "tau": tau, "table": {}} | |
| 22 | + dev_df = dev_df[dev_df["condition"].isin(actions)].copy() | |
| 23 | + dev_df["ctx_bin"] = dev_df["ctx_tokens"].apply(_ctx_bin) | |
| 24 | + for (fam, cb, pair, acc), g in dev_df.groupby(["task_family", "ctx_bin", "pair", "question_access_group"]): | |
| 25 | + rows = [] | |
| 26 | + for a, ga in g.groupby("condition"): | |
| 27 | + q = cluster_bootstrap_mean(ga, "quality_operational", n_boot=n_boot); c = ga[cost_col].mean() | |
| 28 | + rows.append({"action": a, "q_mean": q["mean"], "q_lo": q["lo"], "cost": float(c), "n": q["n"]}) | |
| 29 | + if not rows: continue | |
| 30 | + best = max(rows, key=lambda r: r["q_lo"]) | |
| 31 | + feasible = [r for r in rows if r["q_lo"] >= tau * best["q_lo"]] | |
| 32 | + chosen = min(feasible, key=lambda r: r["cost"]) if feasible else best | |
| 33 | + policy["table"][f"{fam}|{cb}|{pair}|{acc}"] = {"chosen": chosen["action"], "best_static": best["action"], "candidates": rows} | |
| 34 | + return policy | |
| 35 | + | |
| 36 | +def choose(policy: dict, fam: str, ctx_tokens: int, pair: str, acc: str) -> tuple[str, bool]: | |
| 37 | + key = f"{fam}|{_ctx_bin(ctx_tokens)}|{pair}|{acc}" | |
| 38 | + if key in policy["table"]: | |
| 39 | + return policy["table"][key]["chosen"], False | |
| 40 | + # fallback: nearest context bin for the same family/pair, else global best static | |
| 41 | + for k, v in policy["table"].items(): | |
| 42 | + if k.startswith(f"{fam}|") and k.endswith(f"|{pair}|{acc}"): | |
| 43 | + return v["chosen"], True | |
| 44 | + return policy.get("global_best_static", "A1"), True | |
| 45 | + | |
| 46 | +def main(config_path: str) -> int: | |
| 47 | + cfg = yaml.safe_load(open(config_path)) | |
| 48 | + df = load_experiments(cfg["dev_patterns"]) | |
| 49 | + df = df[df["split"] == "dev"] | |
| 50 | + df["ctx_tokens"] = df["message_utf8_bytes"].fillna(0) / 4.0 # proxy when receiver source tokens absent | |
| 51 | + if "source_tokens_receiver" in df: df["ctx_tokens"] = df["source_tokens_receiver"].fillna(df["ctx_tokens"]) | |
| 52 | + df["question_access_group"] = df["question_access"].replace({"none": "blind"}) | |
| 53 | + pol = fit(df, cfg["actions"], cfg["cost_col"], cfg["tau"]) | |
| 54 | + g = df[df["condition"].isin(cfg["actions"])].groupby("condition")["quality_operational"].mean() | |
| 55 | + pol["global_best_static"] = str(g.idxmax()); pol["fitted_on"] = cfg["dev_patterns"]; pol["n_dev_rows"] = int(len(df)) | |
| 56 | + write_json(ROOT / "runs/checkpoints/router_policy.json", pol) | |
| 57 | + print("router fitted:", len(pol["table"]), "cells; global best static:", pol["global_best_static"]) | |
| 58 | + return 0 | |
modified
src/wp30/runner.py
+34 −4
@@ -23,7 +23,7 @@ from .cache.selection import select_cache | ||
| 23 | 23 | from .cache.serialize import build_manifest, serialize_cache, deserialize_cache, codec_compress, codec_decompress |
| 24 | 24 | from .methods import text as TM |
| 25 | 25 | |
| 26 | −FIDELITY = {"A0": "custom", "A1": "custom", "A2": "custom", "A3": "custom", "A4": "custom", "A5": "custom", "A6": "custom", "A7": "custom", | |
| 26 | +FIDELITY = {"C0": "n/a", "C2": "custom", "C3": "custom", "A0": "custom", "A1": "custom", "A2": "custom", "A3": "custom", "A4": "custom", "A5": "custom", "A6": "custom", "A7": "custom", | |
| 27 | 27 | "A8": "official", "B0": "custom", "B1": "custom", "B2": "custom", "B2b": "inspired", "B3": "inspired", "B4": "custom", |
| 28 | 28 | "B5": "faithful_reimplementation", "B6": "faithful_reimplementation", "B9": "custom"} |
| 29 | 29 | |
@@ -54,7 +54,7 @@ def _select_items(cfg): | ||
| 54 | 54 | def _cond_id(c: dict) -> str: |
| 55 | 55 | parts = [c["method"]] |
| 56 | 56 | for k in sorted(c): |
| 57 | − if k not in ("method", "access", "note"): | |
| 57 | + if k not in ("method", "access", "note", "families"): | |
| 58 | 58 | parts.append(f"{k}={c[k]}") |
| 59 | 59 | if "access" in c: |
| 60 | 60 | parts.append(c["access"]) |
@@ -70,6 +70,8 @@ def plan(config_path: str, output: str) -> int: | ||
| 70 | 70 | nq = len(doc["questions"]) if not cfg.get("max_questions_per_doc") else min(len(doc["questions"]), cfg["max_questions_per_doc"]) |
| 71 | 71 | for pair in pairs: |
| 72 | 72 | for c in cfg["conditions"]: |
| 73 | + if c.get("families") and it["family"] not in c["families"]: | |
| 74 | + continue | |
| 73 | 75 | for seed in cfg.get("seeds", [0]): |
| 74 | 76 | rows.append({"experiment_id": cfg["experiment_id"], "condition": _cond_id(c), "method": c["method"], "access": c.get("access", "none"), |
| 75 | 77 | "sender": pair["sender"], "receiver": pair["receiver"], "family": it["family"], "document_id": it["document_id"], |
@@ -158,14 +160,16 @@ def run(config_path: str, resume: bool = False, limit: int | None = None, dry_ru | ||
| 158 | 160 | receiver = get_model(pair["receiver"]); sender = get_model(pair["sender"]) |
| 159 | 161 | dc = DocContext(receiver, doc["text"], fam) |
| 160 | 162 | for cond in cfg["conditions"]: |
| 163 | + if cond.get("families") and fam not in cond["families"]: | |
| 164 | + continue | |
| 161 | 165 | cid = _cond_id(cond); method = cond["method"]; access = cond.get("access", "none") |
| 162 | − if method.startswith("B"): | |
| 166 | + if method.startswith("B") or method.startswith("C"): | |
| 163 | 167 | access = cond.get("access", "blind") |
| 164 | 168 | for seed in cfg.get("seeds", [0]): |
| 165 | 169 | # trials for this (doc, cond, pair, seed) |
| 166 | 170 | pending = [] |
| 167 | 171 | for q in qs: |
| 168 | − tk = trial_key(cfg["experiment_id"], it["document_id"], q["question_id"], method, {k: v for k, v in cond.items() if k != "method"}, | |
| 172 | + tk = trial_key(cfg.get("trial_key_experiment_id", cfg["experiment_id"]), it["document_id"], q["question_id"], method, {k: v for k, v in cond.items() if k not in ("method", "families")}, | |
| 169 | 173 | pair["sender"], pair["receiver"], access, protocol_hash, seed) |
| 170 | 174 | if tk in done: |
| 171 | 175 | n_done += 1; continue |
@@ -217,6 +221,32 @@ def _build_message(method, cond, doc_text, question, sender, receiver, dc: DocCo | ||
| 217 | 221 | out["msg"] = TM.a7_codec(doc_text, cond.get("codec", "zstd")) |
| 218 | 222 | elif method == "A8": |
| 219 | 223 | out["msg"] = TM.a8_llmlingua(doc_text, cond["budget_tokens"], receiver.tokenizer, question, device=cond.get("device", "mps")) |
| 224 | + elif method.startswith("C"): | |
| 225 | + # Track C: cross-checkpoint transfer. Sender cache built on the receiver's exact prefix token ids (shared tokenizer). | |
| 226 | + from .mapper import LinearKVMapper, identity_transfer_negative_control | |
| 227 | + pre = dc.prefix_tokens() | |
| 228 | + assert sender.info.tokenizer_hash == receiver.info.tokenizer_hash, "C methods need a shared tokenizer" | |
| 229 | + t.start("sender_prefill"); s_cache, tp = sender.prefill(pre); t.stop("sender_prefill") | |
| 230 | + t.start("compress") | |
| 231 | + if method == "C0": | |
| 232 | + lm = [int(round(lr * (sender.info.num_layers - 1) / (receiver.info.num_layers - 1))) for lr in range(receiver.info.num_layers)] | |
| 233 | + c = identity_transfer_negative_control(s_cache, receiver.info, lm); info = {"negative_control": True} | |
| 234 | + else: | |
| 235 | + mp = LinearKVMapper.load(ROOT / cond["mapper"], sender.info, receiver.info) | |
| 236 | + c = mp.apply(s_cache); info = {"mapper": cond["mapper"]} | |
| 237 | + if method == "C3": | |
| 238 | + window = dc.split_ids(question)[1] if question is not None else receiver.encode("\n\nSummarize the key facts, identifiers, amounts, dates and statuses of this document.") | |
| 239 | + c, sel = select_cache(receiver, c, cond.get("policy", "attention"), cond["keep_frac"], window_token_ids=window, seed=seed, window_keep=cond.get("window_keep", 32)); info.update(sel) | |
| 240 | + mx.eval([x for cc in c for x in (cc.keys, cc.values)]); mx.synchronize() | |
| 241 | + t.stop("compress") | |
| 242 | + t.start("serialize") | |
| 243 | + man = build_manifest(receiver.info, pre, c, "doc", method, {k: v for k, v in cond.items() if k != "method"}, {"selection_info": {k: v for k, v in info.items() if k != "layer_budgets"}}) | |
| 244 | + payload = serialize_cache(c, man) | |
| 245 | + t.stop("serialize") | |
| 246 | + out.update({"cache": c, "payload": payload, "payload_bytes": len(payload), "raw_payload_bytes": len(payload), "cache_bytes": cache_tensor_bytes(c), "manifest": man, | |
| 247 | + "compress_ms": t.spans["compress"], "serialize_ms": t.spans["serialize"], "codec": "none", "select_info": info, "doc_build_ms": tp["prefill_ms"], "doc_build_peak": int(mx.get_peak_memory()), | |
| 248 | + "prefix_tokens": len(pre), "dense_bytes": cache_tensor_bytes(s_cache), "sender_prefill_ms": tp["prefill_ms"]}) | |
| 249 | + del s_cache | |
| 220 | 250 | elif method.startswith("B"): |
| 221 | 251 | pre = dc.prefix_tokens() |
| 222 | 252 | dense = dc.dense_cache(pre) |
added
tests/test_scoring_and_data.py
+29 −0
@@ -0,0 +1,29 @@ | ||
| 1 | +from wp30.scoring import numeric_match, yesno_match, is_abstention, qa_f1, score_synthetic, extract_numbers | |
| 2 | +from wp30.data.synthetic import generate_document | |
| 3 | +from wp30.data.exec_tasks import generate_exec_task, run_hidden_tests | |
| 4 | + | |
| 5 | +def test_numeric(): | |
| 6 | + assert numeric_match("3,907,415 CAD", "3,907,415") == 1.0 | |
| 7 | + assert numeric_match("The budget is 3907415.", "3,907,415") == 1.0 | |
| 8 | + assert numeric_match("3,907,414", "3,907,415") == 0.0 | |
| 9 | + assert numeric_match("1900.0", "1900", 1e-6) == 1.0 | |
| 10 | + assert extract_numbers("ZR-77Q-0931 and 4,381,220") == [77.0, 931.0, 4381220.0] or 4381220.0 in extract_numbers("ZR-77Q-0931 and 4,381,220") | |
| 11 | + | |
| 12 | +def test_yesno_and_abstain(): | |
| 13 | + assert yesno_match("No, it was postponed.", "no") == 1.0 and yesno_match("Yes", "no") == 0.0 | |
| 14 | + assert is_abstention("unknown") and is_abstention("The document does not say.") and not is_abstention("ZR-77Q-0931") | |
| 15 | + | |
| 16 | +def test_synthetic_deterministic_and_answerable(): | |
| 17 | + a = generate_document(5, 6, 2000); b = generate_document(5, 6, 2000) | |
| 18 | + assert a["text"] == b["text"] and len(a["questions"]) == 15 | |
| 19 | + for q in a["questions"]: | |
| 20 | + if q["answer_type"] in ("exact",): | |
| 21 | + assert q["answer"] in a["text"] or any(al in a["text"] for al in q["aliases"]) or q["qtype"] == "temporal" | |
| 22 | + | |
| 23 | +def test_exec_reference_passes_and_wrong_fails(): | |
| 24 | + t = generate_exec_task(3) | |
| 25 | + assert run_hidden_tests(t["questions"][0]["answer"], t["hidden_tests"])["correct"] == 1.0 | |
| 26 | + assert run_hidden_tests("def net_revenue(rows):\n return 1.0", t["hidden_tests"])["correct"] == 0.0 | |
| 27 | + | |
| 28 | +def test_f1_normalization(): | |
| 29 | + assert qa_f1("The GhostVLAD pooling", ["GhostVLAD pooling"]) == 1.0 | |
| 30 | ||